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PREFACE 


This  study  was  prepared  by  the  Institute  for  Defense 
Analyses  for  the  Office  of  the  Assistant  Secretary  of  Defense 
(MRA&L)  under  Contract  MDA903-79-C-0320 ,  Phase  I  of  Task  Order 
No.  30-1-1,  dated  3  March  1980.  The  study  was  under  the 
technical  direction  of  Messrs.  Russell  R.  Shorey  and  Max  tin 
A.  Meth  of  the  Office  of  the  Special  Assistant  for  Weapon 
Support  Improvement. 

The  purpose  of  this  Phase  I  study  was  to  update  and 
extend  a  1975  IDA  study  of  changes  in  helicopter  reliability/ 
maintainability  (R&M)  characteristics  over  time  [1].  In  this 
study  more  recent  data  have  been  collected;  based  on  the 
combined  data  of  both  studies,  the  observed  helicopter  R&M 
trends  are  summarized. 

The  submission  of  this  paper  is  in  fulfillment  of  the 
contract . 
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a 

AAH 

Abort  Rate 
Aborting  Failures 
Achieved  Availability 


AFCS 

AMSAA 

APU 

AVIM 

AVUM 

BED 


Bench  Test 
BIS 

Burn-in 


Component 


4 

If  reliability  growth  can  be  shown  as 
a  straight  line  on  log-log  paper,  then 
a  is  the  slope. 

Advanced  Attack  Helicopter 

Number  of  aborting  failures  per  flight 
hour 

Failures  serious  enough  to  cause  abort 
of  a  mission 

In  the  UTTAS  and  AAH  programs,  100  per¬ 
cent  less  the  percent  of  maintenance 
downtime;  it  assumes  no  loss  in  avail¬ 
ability  due  to  NOR3  or  administrative 
delay. 

Automatic  Flight  Control  System 

Army  Materiel  Systems  Analysis  Activity 

Auxiliary  Power  Unit 

Aviation  Intermediate  Maintenance 

Aviation  Unit  Maintenance 

Basic  Engineering  Development  Phase; 
that  phase  of  the  UTTAS  and  AAH  pro¬ 
grams  during  which  competitive  proto¬ 
types  were  developed,  built,  and  tested 
(through  DT  II/OT  II). 

Testing  of  components  in  laboratory 
test  equipment 

Board  of  Inspection  and  Survey  (Navy) 

The  operation  of  an  item  to  induce 
infant  mortality  failures  before  field 
use  in  order  to  stabilize  its  opera¬ 
tional  characteristics  upon  commission¬ 
ing  to  those  expected  for  the  useful 
life  period  ■ 

A  basic  assembly  or  part  whicr  per¬ 
forms  a  function 


xv  ii 
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CONUS 
C.O. P. 

CRIM 

Customer's  Risk 


Design  Review 


DODI 

Duane 


DSARC 

DT  II 
Fai 1 ure 


Continental  United  States 

Company  Owned  Prototype 

Component  Report  for  Intensive  Manage¬ 
ment  System 

The  risk,  or  probability,  that  a  product 
will  be  accepted  by  a  reliability  test 
when  it  should  properly  be  rejected. 

Multipurpose  design  verification  pro¬ 
cedure  and  project  management  tool  used 
to  evaluate  the  R&M,  life  cycle  cost, 
performance,  and  various  other  character¬ 
istics  of  an  equipment  at  major  design 
and  testing  milestones . 

Department  of  Defense  Instruction 

An  engineer  at  General  Electric  who 
found  that  reliability  growth  often 
can  be  depicted  as  a  straight  line  on 
log-log  paper  when  cumulative  failure 
rate  is  plotted  against  cumulative 
test  hours  (hence,  the  "Duane  curve"). 

Defense  Systems  Acquisition  Review 
Council 

Development  Testing  -  Two 

The  inability  of  an  item  to  perform 
within  previously  specified  limits. 

There  are  many  ways  of  counting  fail¬ 
ures:  "system  failures"  generally 

include  all  failures;  "mission  failures" 
include  only  those  failures  serious 
enough  to  cause  abort  of  a  mission; 
"primary  failures"  are  those  attribut¬ 
able  to  the  inherent  design  character¬ 
istics  of  the  component  (as  opposed  to 
"non-primary  failures"  which  are  attrib¬ 
utable  to  faulty  maintenance,  improper 
handling,  etc.);  "chargeable  failures" 
are  defined  to  differentiate  failures 
chargeable  to  a  contractor  from  failures 
occurring  in  GFE;  "independent  failures" 
refer  to  initial  failures  which  may  in 
turn  induce  other  "dependent  failures," 
etc.  These  many  categories  of  failures, 
often  ill-defined,  may  introduce  dis¬ 
tortions  in  comparing  different  programs 
and  reporting  systems  (and  sometimes 
result  in  inconsistencies  even  within 
a  given  program  and  reporting  system 
when  ground  rules  for  counting  failures 
are  changed). 
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Fa i 1 ure  Mode 


FDTE 
FFAR 
FH 
FI  P 

Flight  Safety 
Reliability 


GCT 

GFE 

GSE 

GTV 


A  particular  way  in  which  failures 
occur;  the  condition  or  state  which 
is  the  end  result  of  a  particular 
failure  mechanism. 

Force  Development  Test  and  Experimentation 
Folding  Fin  Aircraft  Rocket 
Flight  Hours 

Fleet  Introduction  Program  (Navy). 

In  the  UTTAS  and  AAH  programs,  the  prob¬ 
ability  of  completing  a  one-hour  mission 
without  failure  or  malfunction  which 
results  in  a  forced  landing  or  mishap. 

Government  Competitive  Testing 

Government-Furnished  Equipment 

Ground  Support  Equipment 

Ground  Test  Vehicle 


Helicopter  System 

HLH 

HMMS 

HSR 


IOC 

JC 

LCC 

LMI 

LRU 

Maintenance  Action 


Maintenance  Downtime 


The  helicopter,  consisting  of  all  its 
systems . 

Heavy  Lift  Helicopter 

HELLFIRE  Modular  Missile  System 

Hardware  System  Reliability  failure. 

Any  fault  in  any  equipment  that  results 
in  the  inability  of  the  item  to  perform 
its  required  function  and  requires 
unscheduled  removal  of  that  item. 

(Term  used  in  CH-47D  program). 

Initial  Operational  Capability 

Justification  Code  (Used  in  Army  PIPs) 

Life  Cycle  Cost 

Logistics  Management  Institute 

Line  Replaceable  Unit 

An  action  necessary  for  retaining  an 
item  in  or  restoring  it  to  a  specified 
condition.  Maintenance  actions  may  be 
differentiated  with  respect  to  scheduled 
versus  unscheduled  actions  and  level 
of  maintenance  activity  performing  the 
action. 

The  sum  of  all  clock  time  for  preventive 
and  corrective  (on-aircraft)  maintenance. 
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Maturity 


Maturity  Phase 


MFHBF 

MFHBMA 

Mishap 


Mission  Reliabili ty 


MMH/FH 

MQT 

MTBF 

MTBM 

MTBMA 

MTBR 

MTTR 

Navy  3-M 

NSC 

O&M 

Off-board  MTBF 

Operational  Avail¬ 
ability 


The  phase  of  an  aircraft  program  life 
cycle  when  little  or  no  further  improve¬ 
ment  in  R&M  characteristics  takes  place — 
generally  after  roughly  20,000  to  100,000 
flight  hours  . 

That  phase  of  the  UTTAS  and  AAH  programs 
following  selection  of  the  winner  after 
the  competitive  fly-off  and  before  the 
delivery  of  production  aircraft . ' 

Mean  Plight  Hours  between  Failures . 

(Same  as  MTBF) 

Meaui  Flight  Hours  between  Maintenance 
Actions  .  (Same  as  MTBMA) 

A  malfunction  or  failure  which  is 
potentially  injurious  to  or  results 
in  injury  to  flight  crew,  ground  crew 
or  passengers,  or  damage  to  the  aircraft. 

The  probability  that  the  helicopter 
will  fly  for  a  specified  time  without 
incurring  a  failure  causing  abort  of  a 
mission . 

Maintenance  Man-Hours  per  Flight  Hour 

Military  Qualification  Test 

Mean  Time  Between  Failures 

Mean  Time  Between  (Unscheduled)  Mainte¬ 

nance  (Actions) 

Mean  Time  Between  Maintenance  Actions 

Mean  Time  Between  Removals 

Mean  Time  to  Repair 

The  Navy  Maintenance  Material  Manage¬ 
ment  reporting  system 

Naval  Safety  Center 

Operation  and  Maintenance 

For  helicopters,  the  first  flight  is 
the  time  that  the  design  is  considered 
off-board  . 

The  probability  that  a  requested  air¬ 
craft  is  not  down  for  maintenance  or 
spare  parts. 


Operational  Failures 


OT  II 

PEP 

PIP 

Producer’s  Risk 


PVT-G 

RAM 

RAM-D 

RAM/LOG 

RDT&E 

Removal  Rate 

RFP 

RFQ 

RIW 

RPM 

R&M  or  R/M 

S  DC 

SOR 


STA 


In  the  UTTAS  and  AAH  programs,  all 
system  failures  plus  dependent 
failures,  operator  and  maintenance 
errors,  foreign  object  damage,  and 
GSE  induced  malfunctions. 

Operational  Testing  -  Two 

Procurement  Engineering  and  Planning 

Product  Improvement  Program 

The  risk,  or  probability,  that  a 
product  will  be  rejected  by  a  reli¬ 
ability  test  when  it  should  properly 
be  accepted. 

Production  Verification  Testing  - 
Government 

Reliability,  Availability,  Maintain¬ 
ability 

RAM-Durability  (selected  aircraft,  in 
the  Black  Hawk  program) 

Reliability,  Availability,  Maintain¬ 
ability,  Logistics  Sample  Data  System 

Research,  Development,  Test  and  Evalua 
tion 

The  number  of  removals  of  a  component 
per  unit  time 

Request  for  Proposal 

Request  for  Quotation 

Reliability  Improvement  Warranty 

Reliability  Planning  and  Management 

Reliability  and  Maintainability 

Sample  Data  Collection  System 

System  Operational  Reliability.  As 
used  in  the  CH-47D  program,  a  system 
failure  is  called  an  SOR  failure.  It 
includes  all  Primary  and  Non-Primary, 
Independent  and  Dependent  Failures. 

Static  Test  Article 


System  Reliability  The  probability  that  the  helicopter 

will  fly  for  a  specified  time  without 
incurring  a  failure. 

TADS/PNVS  Target  Acquisition  Designation  Sight/ 

Pilot  Night  Vision  Sensor 
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TAMMS 

TBO 


The  Army  Maintenance  Management  System 

Time  Between  Overhaul.  This  is  the 
maximum  number  of  flight  hours  that  a 
component  is  scheduled  to  operate 
between  overhauls.  The  actual  time 
between  overhauls  may  be  less. 

TSARCOM  Troop  Support  and  Aviation  Materiel 

Readiness  Command 

UMSDC  Unscheduled  Maintenance  Sample  Data 

Collection  System 

USASC  U.S.  Army  Safety  Center 

UTTAS  Utility  Tactical  Transport  Aircraft 

System 

WUC  Work  Unit  Code 

66-1  Air  Force  Maintenance  Management  System 

(name  derived  from  the  Air  Force  manual 
that  sets  out  maintenance  policy.) 
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SUMMARY 


This  study  was  conducted  in  response  to  Phase  I  of  Task 
Order  No.  80-1-1,  "Helicopter  Reliability  and  Maintainability 
Characteristics."  It  updates  and  extends  a  1975  IDA  study  of 
changes  in  helicopter  reliability/maintainability  (R&M)  char¬ 
acteristics  over  time  [1] .  In  this  study  we  have  collected 
more  recent  data  and,  based  on  the  combined  data  of  both  studies, 
have  summarized  the  observed  helicopter  R&M  trends.  We  have 
compared  the  trends  observed  during  the  development  phase  with 
those  of  the  production  phase.  In  general,  the  data  obtained 
in  this  study  for  the  more  recent  programs  are  compatible  with 
the  data  presented  in  the  1975  study  for  the  earlier  programs. 

The  study  relates  R&M  characteristics  to  test  and  opera¬ 
tional  flight  hours  and  calendar  time.  We  were  not  able  to 
estimate  the  associated  dollar  expenditures  for  R&M  improve¬ 
ment  because  current  cost  accounting  systems  do  not  clearly 
separate  expenditures  for  R&M  improvement  from  expenditures  for 
the  many  other  aspects  of  helicopter  development  and  production 
programs.  The  combined  effects  of  initial  "off-board"  reli¬ 
ability  and  subsequent  rate  of  reliability  improvement  in 
achieving  reliability  goals  is  analyzed. 

A.  CONCLUSIONS 

Tables  S-l  and  S-2  summarize  data  on  helicopter  reliability 
and  maintainability  (R&M)  trends  during  the  development  and  pro¬ 
duction  phases  of  helicopter  programs,  respectively.  Our  1975 
study  contained  all  the  R&M  trend  data  that  we  were  able  to 
assemble  at  that  time  on  helicopter  programs  up  to  the  early 


5-1 


R&M 


I- 10,  All-  IG,  MTBF  at  100  Fll  was 
I-58A  20-30  percent  of  MTBF 

of  mature  production 
aircraft  (p.  S-4) 


,  i  rmed  ) 


1970s.  Those  data  are  included  below  the  double  horizontal 
lines  of  Tables  S-l  and  S-2;  page  references  are  given  in 
parentheses.  Data  obtained  in  the  current  study  are  summarized 
above  the  double  lines.  Principal  conclusions  based  on  the 
combined  data  of  both  studies  are: 

•  Substantial  R&M  growth  occurs  during  development 

•  Failure  rates  generally  show  worsening  trends  for 
production  systems 

•  On  limited  evidence  (UH-60)  a  specifically  funded 
maturation  phase  can  result  in  modest  improvement 
in  production  over  development  results 

•  On  limited  data  (CH-47D)  major  modification  programs 
of  fielded  systems  can  improve  R&M  but  are  expensive 

•  Accident  rates  generally  show  major  improvement 
after  fielding  (while  maintenance  demands  worsen) 

•  On  average  Component  Improvement  Programs  (CIPs) 
for  dynamic  components  result  in  some  improvement, 
but  performance  modifications  may  result  in  worsen¬ 
ing  failure  trends 

•  On  a  limited  sample,  recent  commercial  aircraft  pro¬ 
grams  either  have  achieved  high  initial  reliability 
or  complete  intensive  growth  in  the  first  two  years 
of  production 

R&M  trends  during  each  program  phase  are  discussed  below.  It 
should  be  noted  that  this  study  only  shows  R&M  trends  for  heli¬ 
copters.  Thus,  they  are  largely  representative  of  complex 
mechanical  type  systems  but  are  not  necessarily  representative 
of  complex  avionics  subsystems  such  as  those  presently  being 
developed  for  the  AH-64A  and  LAMPS  Mark  III  programs. 

B.  DEVELOPMENT  PHASE 

Data  were  obtained  on  five  R&M  characteristics:  (1)  sys¬ 
tem  failure  rate,  (2)  abort  rate,  (3)  achieved  availability, 

(4)  maintenance  manhours  per  flight  hour,  and  (5)  component 
removal  rate.  In  every  case,  R&M  characteristics  improved 
during  the  development  phase.  However,  after  improvement 
during  the  Basic  Engineering  Development  phase,  the  YUH-SOA 


exhibited  a  degradation  in  R&M  characteristics  during  the 
Maturity  phase.  Some  possible  reasons  for  this  worsening  are 
discussed  in  Chapter  II,  Section  I. 

Aborting  failure  rates  seem  to  improve  more  rapidly  than 
system  failures;  this  is  probably  due  to  the  fact  that  abort¬ 
ing  failures  (being  more  serious  in  nature)  receive  more  cor¬ 
rective  attention  than  failures  in  general.  For  system  and 
aborting  failures,  the  data  obtained  in  the  current  study 
(above  the  double  line)  basically  corroborate  the  data  from 
the  1975  study  (below  the  double  line) . 

The  results  of  Table  S-l  indicate  quite  strongly  that  all 
helicopter  R&M  measures  improve  during  the  development  phase. 

In  a  number  of  cases,  the  R&M  data  have  been  presented  in 
the  "Duane"  format,  and  the  "a's"  presented  in  Table  S-l  refer 
to  the  Duane  equation.  Duane  [2]  found  that  for  some  equip¬ 
ments,  cumulative  failure  rate  versus  cumulative  operating 
hours  resulted  in  a  straight  line  when  the  data  points  were 
plotted  on  log-log  paper.  He  expressed  these  "Duane  curves" 
by  the  equation 

CFR  =  At“a  , 

where 

CFR  =  cumulative  failure  rate 

A  =  initial  failure  rate  (intersection  at  t=l  hour) 
t  =  cumulative  operating  hours 
a  =  exponent. 

-a  denotes  the  slope  of  the  cumulative  failure-rate  line:  when 
a  is  positive,  there  is  a  decreasing  failure  rate;  when  it  is 
negative,  there  is  an  increasing  failure  rate.  If  cumulative 
failure  rate  versus  cumulative  operating  hours  falls  on  a 
straight  line  (the  "Duane  curve"),  then  instantaneous  failure 
rate  will  also  fall  on  a  straight  line  with  the  equation: 

IFR  =  ( 1-a) At-a  . 
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The  Duane  paper  presented  data  for  five  equipments  whose 
a's  fell  in  the  range  of  0.4  to  0.5-  Because  of  the  scarcity 
of  reliability-growth  data,  the  Duane  data  (a's  of  about  0.5) 
have  been  used  in  predicting  reliability  growth  for  many  other 
equipment  programs,  including  helicopters.  However,  the  heli¬ 
copter  data  presented  herein  indicate  that  a's  for  various 
measures  of  helicopter  reliability  tend  to  be  much  lower.' 

The  helicopter  R&M  data  indicate  somewhat  erratic  trends 
of  failure  rate  improvement  during  helicopter  development 
programs.  However,  in  at  least  a  very  approximate  way,  the 
programs  tend  to  be  characterized  by  the  Duane  growth  process.. 
Based  upon  the  UH-60A  Black  Hawk  system  reliability  data,  let 
us  hypothesize  a  "typical"  helicopter  development  program  char¬ 
acterized  by  a  =  0.13  and  a  cumulative  failure  rate  at  100 
flight  hours  =  0.7.  These  two  values  permit  us  to  calculate 
\  =  1.274.  The  cumulative  and  instantaneous  failure  rates  for 
the  "typical"  helicopter  are  shown  in  Figure  S-l.  Note  that 
the  basic  characteristic  of  the  Duane  curves  is  that  the  failure 
rate  is  reduced  by  the  same  proportion  for  each  order  of  magni¬ 
tude  increase  in  cumulative  flight  hours.  In  the  case  of 
Figure  S-l,  the  failure  rate  at  100  flight  hours  is  about  74 
percent  of  that  at  10  flight  hours;  at  1,000  flight  hours  it  is 
74  percent  of  that  at  100  flight  hours,  etc.  The  nature  of  the 
relationship  becomes  much  more  dramatic  visually  when  the 
instantaneous  failure  rate  is  replotted  on  a  linear  grid  (see 
Figure  S-2).  .  On  Figure  S-2  we  have  added  a  dashed  line  (a=0.4) 
representing  the  fastest  rate  of  improvement  we  are  aware  of 
for  any  helicopter  development  program  (the  CH-53  abort  rate). 
For  comparison  with  the  "typical"  helicopter  (a=0.13),  we  have 
assumed  the  same  cumulative  failure  rate  at  100  flight  hours 
of  0.7. 
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The  failure  rate  is  driven  down  during  the  development 
phase  by  a  continuous  cycle  of  "fail  and  fix"  consisting  of 
the  following  basic  steps: 

1.  Test  hours  accumulated: 

a.  bench  test 

(1)  transmission  test  stand 

(2)  rotor  blade  fatigue  tests 

(3)  flight  control  fatigue  tests 

(4)  miscellaneous  component  fatigue  tests 

(5)  failure  data  collected 

b.  rotor  whirl  tower  test 

c.  ground  test  vehicle 

d.  flight  test. 

2.  Failures  analyzed: 

a.  failure  mode  identified 

(1)  design  deficiency 

(2)  quality  control 

(3)  unanticipated  environmental  conditions 

b.  corrective  action  established. 

3.  Redesign/rework  to  eliminate  cause  of  failure. 

4.  Test  redesigned  reworked  component  to  verify  adequacy 

of  corrective  action. 

5.  Replace  old  part  by  new  part  in  the  system  (test 

aircraft,  spares,  etc.). 

As  can  be  seen,  the  reliability  growth  process  involves  many 
Interrelated  elements.  The  convent  il  way  of  analyzing  changes 
in  helicopter  R&M  characteristics  o\ time  is  to  plot  their 
values  as  a  function  of  cumulative  flight  hours.  When  using 
such  data,  one  must  realize  that  the  flying  per  se  is  only  one 
element  in  the  R&M  growth  process. 

The  Duane  equation  indicates  that  failure  rate  as  a  given 
number  of  flight  hours  is  a  function  of  both  initial  failure 
rate  (A)  and  the  rate  of  improvement  (a).  Figure  S-3  shows 
for  various  a's  the  cumulative  MTBF  at  100  flight  hours,  in 


Figure  S-3.  CUMULATIVE  SYSTEM  MEAN  TIME  BETWEEN  FAILURES 
(MTBF)  AT  TOO  HOURS  VERSUS  GROWTH  RATE 
REQUIRED  TO  ACHIEVE  MATURE  PROGRAM  GOALS 


percent  of  mature  program  goal,  required  to  achieve  the  mature 
program  goal.  A  program  is  generally  considered  to  have 
reached  maturity  after  20 ,000  to  100,000  flight  hours,  and 
Figure  S-3  shows  the  relationships  for  both  values.  For 
example,  if  failure  rate  improves  at  the  rate  a  =  0.2,  the 
goal  at  100,000  flight  hours  will  be  achieved  If  the  cumulative 
MTBF  at  100  flight  hours  is  20  percent  of  the  mature  program 
goal . 

On  Figure  S-3  are  plotted  the  values  for  the  following 
helicopters  for  which  goals  were  established  and  for  which  we 
were  able  to  obtain  Duane  curves: 
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Mature 

Program 

MTBF  Goal 

Cumulative 

System  MTBF 
at  100  Hours 

Growth 

Rate 

(a) 

AH-56A 

10.60 

0.59 

0.16 

UH-60A 

4.00 

1.40 

0.13 

YAH-64 

3.25 

0.37 

0.09 

CH-53E 

0 .92 

0.28 

0.22 

CH-47D 

1.40 

0.90 

0.14 

that  most 

of  the  a's  lie 

in  the  0.1  to  0.2 

range . 

that  rate  of  growth  can  be  maintained  to  20,000  or  100,000 
flight  hours,  then  the  cumulative  MTBF  at  100  flight  hours 
must  be  approximately  one-third  of  the  mature  goal  in  order 
for  the  helicopter  to  meet  its  mature  program  goal. 

The  UH-60A,  CH-47D  and  CH-53E  all  appear  to  be  capable 
of  meeting  their  mature  program  goals.  The  two  major  modi¬ 
fication  programs  (rhe  CH-47D  and  CH-53E)  appear  much  more 
likely  to- meet  their  failure  rate  objectives  than  the  com¬ 
pletely  new  helicopter  programs.  The  AH-56A  was  unlikely  to 
meet  its  mature  program  goal  (which  was  much  more  ambitious 
than  those  of  the  other  programs).  Since  its  cumulative  MTBF 
at  100  hours  was  only  5.6  percent  of  its  mature  goal,  its  a 
would  have  had  to  increase  from  0.16  to  approximately  0.4  in 
order  to  achieve  its  mature  goal.  In  fact,  the  AH-56A  pro¬ 
gram  was  terminated  after  1,426  flight  hours  of  developmental 
testing.  The  AH-64  may  have  difficulty  in  meeting  its  goal; 
its  a  will  have  to  increase  from  the  0.09  experienced  to  date 
to  approximately  0.17  in  order  to  meet  its  goal  by  100,000 
flight  hours. 
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C.  PRODUCTION  PHASE 

Data  were  obtained  on  ten  R&M  characteristics:  (1)  system 
failure  rate,  (2)  abort  rate,  (3)  achieved  availability,  (4) 
maintenance  manhours  per  flight  hours,  (5)  component  removal 
rate,  (6)  component  time  between  overhaul,  (7)  operational 
availability,  (8)  accident  rate,  (9)  mishap  rate,  and  (10)  mean 
time  between  maintenance  actions.  Table  S-2  indicates  a  mixture 
of  improvement,  degradation,  or  approximately  no  change  for 
different  R&M  measures  for  the  different  helicopter  programs. 
Trends  of  these  characteristics  are  discussed  in  their  order 
of  listing  at  the  top  of  Table  S-2. 

1 •  System  Failure  Rate 

The  only  engine  entry  (The  T-53)  showed  improvement  in  suc¬ 
cessive  models.  Some  of  the  helicopters  showed  improvement 
early  in  their  production  phase  ( YUH-60A,  OH-6A,  CH-46,  CH-54A/ 
CH-54B).  However,  many  of  them  showed  a  long  term  degradation 
( CH-46 ,  CH-54A/CH-54B,  UH-1D) ,  and  the  3-M  data  for  the  Navy 
H-l,  H-2,  H-3,  H-46  and  H-53  showed  a  uniformly  worsening  trend 
for  every  major  component  group  for  every  basic  helicopter  type 
from  1968  to  1978.  The  general  picture  emerging  from  these  data 
is  that  there  appears  to  be  some  early  improvement  during  the 
production  phase,  but  that  the  longer  term  trend  shows  degrada¬ 
tion. 

2 .  Abort  Rate 

Abort  rate  improved  in  all  cases.  As  was  hypothesized  in 
the  discussion  of  the  development  phase  above,  this  is  probably 
due  to  the  fact  that  aborting  failures  receive  more  corrective 
attention  than  failures  in  general.  (However,  see  9.  Mishap  Rate, 
below ) . 
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3. 


Achieved  Availability 


The  only  entry  for  this  measure  shows  improvement. 

4 .  Maintenance  Manhours  per  Flight  Hour  (MMH/FH) 

The  only  engine  entry  (the  T-53)  showed  improvement  in 
successive  models.  For  helicopters,  we  have  mixed  results: 
some  improved  (YUH-60A,  CH-47,  UH-1D,  AH-1G) ;  some  worsened 
(Navy  H-l,  H-2 ,  H-3,  H -46,  H-53  ( 3-M  data),  CH-46  and  "All 
USAF  Helicopters");  and  some  were  approximately  constant 
("All  Army  Helicopters").  We  believe  the  Navy  3-M  data  are 
the  most  reliable  long  term  trend  data.  They  indicate  that 
MMH/FH  worsened  for  every  major  component  group  and  every  basic 
helicopter  type  from  1968  to  1978. 

5 .  Component  Removal  Rate 

Of  the  three  engine  entries,  two  (the  T-53  and  "Several 
Engines")  showed  improvement,  while  the  other  (the  T— 55 )  was 
approximately  constant.  Again  some  of  the  helicopters  improved 
(the  0H-6A,  CH-53A/D,  CH-47  transmissions,  CH-53B) ,  some 
worsened  (CH-46,  CH-54A,  AH-1G) ,  and  some  were  approximately 
constant  (CH-47  "other  components,"  OH-58A) .  In  general, 
engines  and  transmissions  (the  most  expensive  components  to 
overhaul)  appear  to  definitely  improve,  while  all  other  com¬ 
ponents  improve  less  markedly  or  tend  to  remain  approximately 
constant . 

6 .  Component  Time  Between  Overhaul 

In  most  cases,  time  between  overhaul  (TBO)  improved.  A 
TBO  establishes  the  maximum  time  that  a  component  can  be  flown. 
However,  components  may  fail  before  reaching  their  TBOs  and 
hence  the  removal  rate  (5.  above)  is  a  more  significant  measure 
of  component  quality. 
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7. 


Operational  Availability 


The  three  entries  for  this  measure  from  our  1975  report 
indicated  a  general  improvement  during  the  early  production 
phase  followed  fay  an  approximately  constant  availability.  More 
recent  data  indicate  that  on  average  Army  operationally  ready 
rates  generally  remain  constant  over  time. 

8.  Accident  Rate 

Both  Army  and  Navy  data  indicate  that  accident  rates  (both 
those  involving  materiel  and  total)  improved  for  all  helicopter 
types.  As  was  hypothesized  in  the  discussion  of  system  and 
abort  failure  rates,  it  appears  that  the  more  serious  types  of 
failures  (those  causing  accidents)  tend  to  be  corrected,  while 
minor  problems  are  let  go. 

9 .  Mishap  Rate 

Both  Army  and  Navy  data  indicate  that  mishap  rates  (both 
those  involving  materiel  and  total)  worsened  for  all  helicopter 
types.  We  are  puzzled  by  this  finding  because  mishaps  lie 
between  aborting  failures  and  accidents  in  degree  of  serious¬ 
ness,  and  both  abort  rates  and  accident  rates  seem  to  improve 
over  time.  Perhaps  more  warning  indicators  have  been  added  to 
the  helicopters  over  time,  and  they  have  resulted  in  more  pre¬ 
cautionary  landings  (one  type  of  mishap)  but  fewer  accidents. 
Final  determination  of  the  reason  for  increasing  mishap  rates 
would  require  detailed  analysis  of  their  causes. 

1 0 .  Mean  Time  Between  Maintenance  Actions 

Both  entries  Indicate  a  worsening  in  this  measure.  Again, 
the  3-M  data  are  believed  to  be  reliable  and  (as  in  the  case  of 
system  failure  rate  and  MMH/FH)  they  show  a  worsening  trend  for 
every  major  component  group  for  every  basic  helicopter  type  from 
1963  to  1973. 
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The  overall  pattern  shown  by  these  data  can  be  summarized 
as  follows.  It  appears  that  the  more  serious  failure  modes 
(those  causing  aborts  and  accidents)  tend  to  be  corrected  and 
therefore  show  an  improvement  trend,  while  the  less  important 
failure  modes  (those  making  up  the  bulk  of  mishaps  and  system 
failures)  are  not  corrected  and  therefore  show  a  worsening 
trend  as  the  fleet  ages.  Similarly,  the  most  important  com¬ 
ponents  (the  engines  and  transmissions)  tend  to  be  improved 
and  therefore  show  improved  removal  rates  while  the  lesser 
components  show  a  more  constant  removal  rate  trend. 

D.  CHANGES  IN  COMMERCIAL  AIRCRAFT  RELIABILITY/MAINTAINABILITY 

CHARACTERISTICS  OVER  TIME 

Over  80  percent  of  the  Free  World's  commercial  airliners 
are  produced  in  the  U.S.  and  are  widely  acknowledged  to  be  the 
best  in  the  world.  Accordingly,  their  R&M  characteristics  are 
probably  close  to  optimum  and  may  provide  insights  useful  in 
formulating  R&M  policies  for  military  aircraft. 

R&M  data  for  first  (B-707,  DC-8),  second  (DC-9,  B-727, 
3-737)  and  third  (3-7^7,  DC-10,  L-1011)  generation  commercial 
jet  transports  were  obtained  from  the  manufacturers.  The  trends 
in  maintenance  costs,  maintenance  manhours,  and  mechanical 
schedule  reliability  are  summarized  in  Table  S-3.  First  gen¬ 
eration  commercial  jets  were  the  only  ones  to  show  long  term 
(i.e.,  greater  than  three  year)  improvement  trends.  Second 
generation  jets  showed  little  improvement  in  any  R&M  measure 
after  introduction  into  service;  they  were  basically  good  when 
introduced.  Third  generation  jets  experienced  some  reliability 
problems  with  their  high  by-pass  ratio  engines,  but  R&M  char¬ 
acteristics  stabilized  after  two  or  three  years. 

It  appears  that  the  commercial  aircraft  manufacturers 
strive  to  develop  their  aircraft  to  a  mature  level  of  R&M  char¬ 
acteristics  prior  to  introduction  of  the  aircraft  into  service. 
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Table  S-3.  SUMMARY  OF  TRENDS  IN  COMMERCIAL  AIRCRAFT 

RELIABILITY/ MAINTAINABILITY  CHARACTERISTICS 


Jet  Transport 
Generation 

Direct 
Maintenance 
Costs  in 
Constant 
Dollars 

Maintenance 
Manhours 
per  Flying 
Hour 

Mechanical 

Schedul e 

Rel  iabil ity 

First  Generation 
(Four  Engine  Jets) 

Decreased 
about  35% 
over  first 

17  years. 

Decreased 
about  50% 
over  first 

17  years. 

B- 707- 100  and  DC-8 
required  about  five 
years  to  maturity; 
later  B-707  models 
required  two  or 
three  years. 

Second  Generation 
(Twin  and  Tri  Jets) 

Approxi¬ 

mately 

constant 

SI i ght 
reduction 

B- 727  and  737  and 

DC- 9  all  had  high 
initial  reliability; 
DC-9  grew  to  a 
slightly  higher 
level  during  first 
three  years  of 
service. 

Third  Generation 
(Wide  Body  Jets) 

B- 747  &  L-1011 

DC- 10 

Approxi¬ 

mately 

constant 

Some 

increase 
due  to 
engines 

Approxi¬ 

mately 

constant 

Required  two  to 
three  years  to 
!  maturity 

'.•then  problems  have  developed  in  the  last  two  generations  of 
jets,  they  have  been  corrected  within  two  or  three  years 
following  introduction  into  service;  thereafter,  R&M  char¬ 
acteristics  have  remained  quite  constant. 


3-16 


E. 


CONSIDERATIONS  IN  THE  ALLOCATION  OF  RESOURCES  FOR  R&M 
GROWTH  DURING  THE  DEVELOPMENT  PHASE  VERSUS  DURING  THE 
PRODUCTION  PHASE 

There  are  a  number  of  factors  that  should  be  considered 
in  deciding  whether  to  allocate  resources  for  R&M  growth  during 
the  development  phase  or  during  the  production  phase  of  a  heli¬ 
copter  program.  Factors  that  favor  allocation  of  resources 
during  each  phase  are  summarized  in  Table  S-4  and  are  discussed 
below . 


Table  S-4.  FACTORS  THAT  FAVOR  ALLOCATION  OF  RESOURCES 
FOR  R&M  GROWTH  DURING  THE  DEVELOPS  PHASE 
AND  DURING  THE  PRODUCTION  PHASE 


Development  Phase 

Production  Phase 

•  . 

1.  Should  achieve  a  greater 
improvement  in  R&M  per  unit 
cost  and  time  because  of 

Duane  curve  characteristics. 

2.  R&M  growth  program  should  be 
more  cost-effective  because 
of  controlled  management  and 
operating  environment. 

3.  Improvements  do  not  have  to 
be  retrofitted  on  delivered 
aircraft. 

4.  Improved  R&M  characteristics 
-  available  over  entire  life 

of  aircraft. 

1.  Development  phase  costs  less 
(but  production  phase  will 
cost  more  if  R&M  growth  is 
deferred  to  it). 

2.  Development  phase  may  take 
less  time,  resulting  in  pos¬ 
sible  earlier  IOC  date. 

3.  Earlier  discovery  of  those 
failure  modes  induced  by 
field  environment. 

1 .  Factors  Favoring  R&M  Growth  During  Development  Phase 

The  discussion  which  follows  is  tied  to  Table  S-4  in  its 
listing  of  factors  during  the  two  phases  of  a  helicopter  program 

1.  As  discussed  above,  helicopter  development  programs, 
in  a  very  rough  way,  tend  to  follow  the  Duane  growth  process. 
This  process  is  characterized  by  a  continual  reduction  in  the 
degree  of  R&M  improvement  per  unit  of  cost  or  time  required  to 


achieve  the  improvement  (see  Figures  S-2  and  S-3) •  Since  fewer 
flight  hours  have  been  accumulated  in  the  development  phase 
than  in  the  production  phase,  it  should  be  possible  to  achieve 
a  greater  degree  of  R&M  improvement  per  unit  of  cost  or  time 
in  the  development  phase.  Further,  while  virtually  all  programs 
exhibit  R4M  improvement  during  the  development  phase,  there  is 
no  clear-cut  evidence  that  R&M  characteristics  in  general  .improve 
during  the  production  phase.  Indeed,  some  data  indicate  that 
they  worsen  (see  3-M  data  of  Chapter  III,  Section  I). 

2.  R&M  growth  programs  during  the  development  phase  would 
be  conducted  at  the  manufacturer’s  plant  or  at  a  service  test 
facility  in  CONUS  where  manufacturer’s  personnel  could  be  sta¬ 
tioned.  Accordingly,  the  operating  environment  is  such  that 
information  on  failures  can  be  quickly  collected  and  fixes 
developed,  thus  facilitating  the  R&M  growth  process.  On  the 
other  hand,  once  a  helicopter  is  in  production  and  operating 

in  the  field  '( perhaps  overseas),  the  collection  and  transmittal 
of  failure  data  is  much  less  complete  and  fast,  and  the  time 
required  to  incorporate  fixes  into  aircraft  in  the  field  is 
much  greater.  Further,  in  order  to  incorporate  changes  in  a 
production  program  it  is  necessary  to  change  production  drawings/ 
processes/tooling  and  in  general  interfere  with  the  smooth  func¬ 
tioning  of  the  production  process.  Hence  R&M  growth  programs 
should  be  considerably  more  cost-effective  during  the  develop¬ 
ment  phase  because  of  the  more  favorable  management  and  operating 
environment.  One  quantitative  survey  concluded  that  production 
phase  changes  are  ten  times  as  costly  as  development  phase 
changes  [3]  . 

3.  If  design  changes  to  achieve  R&M  growth  are  incorpo¬ 
rated  in  the  development  phase,  then  later  production  aircraft 
will  have  the  improved  designs  incorporated  in  them  when  they 
are  built.  However,  if  changes  are  made  during  the  production 
phase,  then  the  changes  must  be  retrofitted  into  those  aircraft 
which  have  already  been  produced.  This  retrofitting  is  more 


expensive  than  incorporating  changes  in  the  initial  construc¬ 
tion  of  the  aircraft.  Further,  retrofitting  aircraft  in  the 
field  degrades  the  mission  operational  readiness  of  the  units 
to  which  they  are  assigned. 

4.  If  R&M-related  changes  are  incorporated  during  the 
development  phase,  the  benefits  of  these  changes  are  available 
over  the  entire  life  of  the  aircraft.  If  changes  are  made 
during  the  production  phase,  then  the  benefits  are  not  realized 
in  the  already-produced  aircraft  until  they  are  retrofitted. 

2 .  Factors  Favoring  R&M  Growth  During  Production  Phase 

1.  and  2.  The  principal  advantage  of  deferring  R&M  growth 
resources  from  the  development  phase  to  the  production  phase 
is  that  the  cost  and  schedule  time  required  for  development  may 
be  reduced.  As  a  result,  an  earlier  IOC  date  can  be  achieved. 
This  could  be  a  very  important  consideration  in  some  programs, 
depending  on  the  military  threat  situation. 

3.  Some  R&M  problems  only  become  apparent  when  an  aircraft 
is  operating  in  its  normal  field  environment.  These  problems 
will  be  discovered  earlier  because  of  the  earlier  IOC  date,  but 
a  special  process  involving  data  collection,  engineering  follow¬ 
up  and  production  modification  is  required  for  timely  incorpo¬ 
ration  of  fixes  (as  in  the  Black  Hawk  program). 


Chapter  I 


RESOURCES  INVESTED  IN  RELIABILITY  VERSUS  RELIABILITY 
ACHIEVED:  A  SURVEY  OF  THE  LITERATURE 

A.  INTRODUCTION 

The  costs  of  ownership  typically  account  for  over  half 
of  the  total  life  cycle  costs  of  major  weapon  systems.  Con¬ 
sequently,  reduction  of  the  cost  of  ownership  has  become  a 
matter  of  increasing  concern  for  defense  policy  makers. 

Recently  published  Department  of  Defense  Directive  5000.4  [4] 
deals  with  the  setting,  monitoring,  and  enforcement  of  reli¬ 
ability  and  maintainability  (R&M)  goals,  long  recognized  as 
having  a  significant  impact  on  total  support  costs  of  weapon 
systems . 

Implicit  in  the  policies  set  forth  in  [4]  is  the  assump¬ 
tion  that  the  impact  of  alternative  R&M  goals  on  both  the 
acquisition  and  ownership  costs  of  a  new  system  can  be  eval¬ 
uated  early  in  the  development  cycle  of  that  system.  In  con¬ 
trast  to  that  assumption,  a  recent  Air  Command  and  Staff 
College  research  study  [5]  concluded  that  "little  has  been 
written  on  how  to  establish  an  effective  reliability  growth 
program  or  the  tools  and  resources  required  to  implement  such 
a  program."  The  purpose  of  this  chapter  is  to  provide  a  sum¬ 
mary  of  selected  studies  that  have  appeared  in  the  literature 
dealing  with  the  latter  issue — the  relationship  between 
resources  invested  in  reliability  and  reliability  achieved. 

Figure  1  depicts  the  issue  schematically.  Subject  to 
state-of-the-art  technological  constraints,  R&M  program  objec¬ 
tives,  in  theory,  can  be  varied  in  order  to  adjust  the  relative 
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contributions  to  total  system  life  cycle  cost  of  the  develop¬ 
ment  procurement  ,  and  ownership  phases  of  the  program.  In 
order  to  understand  the  linkage  between  R&M  program  goals  and 
life  cycle  costs,  however,  it  is  necessary  to  understand — 

(1)  what  resource  levels  are  required  during  development 
in  order  to  achieve  the  development  R&M  objectives; 

(2)  how  those  objectives  demonstrated  during  development 
translate  into  field  R&M  attributes  of  the  system; 

(3)  now  those  field  attributes  affect  the  cost  of  owner¬ 
ship  of  the  system;  and 

(4)  whether  or  not,  and  at  what  cost,  R&M  values  can  be 
improved  once  the  system  has  been  fielded. 


Figure  1.  IDEALIZED  R&M  PLANNING  PROCESS 
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In  addition,  if  the  relationship  between  reliability  objectives, 
performance  objectives,  and  mission  requirements  is  included  in 
the  planning  loop,  then  R&M  can  exert  significant  leverage  on 
the  procurement  cost  by  influencing  the  size  of  the  total  buy. 

In  this  chapter  we  concentrate  on  (1)  and  (2)  above. 
Question  (3)  can  be  reasonably  well  quantified  through  the  use 
of  models  designed  for  that  purpose  employing  deterministic 
and/or  probabilistic  cost  equations  or  Monte  Carlo  simulation 
methods  (see,  for  example,  [6],  [7],  [8]),  but  will  not  be  dis¬ 
cussed  below.  Little  attention  appears  to  have  been  devoted  in 
the  literature  to  question  (4),  apart  from  proposed  methods  for 
evaluating  the  cost-effectiveness  of  individual  product  improve¬ 
ments  ([9].  [10]),  and  one  survey  [3]  which  concluded  that  the 
cost  of  effecting  a  change  to  a  system  after  it  is  fielded  is 
roughly  ten  times  the  cost  of  making  that  change  prior  to  pro¬ 
duction.  The  inclusion  of  buy  size  as  a  decision  variable  in 
the  R&M  planning  loop  has  been  incorporated  into  one  model  of 
the  R&M  process  [11]  which  will  be  discussed  in  Section  D.4 
below. 

In  the  context  of  this  report,  the  primary  focus  of  this 
chapter  is  on  helicopters.  Historically,  however,  the  majority 
of  published  reliability  growth  efforts  have  been  concerned  with 
electronics  equipment,  and  a  brief  survey  of  relevant  studies 
from  that  segment  of  the  literature  is  included  as  well.  The 
narration  is  necessarily  disjointed.  The  literature  is  rela¬ 
tively  sparse,  and  differences  in  both  definitions  and  focus 
among  the  various  publications  leave  large  gaps  in  the  existing 
body  of  knowledge. 

B.  MODELS  OF  RELIABILITY  GROWTH 

In  1970,  Selby  and  Miller  [12]  proposed  the  methodology  for 
planning  and  monitoring  reliability  programs — known  as  Reliabili 
Planning  and  Management  (RPM)--which  was  based  on  the  1964 
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empirical  observation  of  J.T.  Duane  [2]  that  a  predictable 
relationship  exists  between  test  time  and  reliability  achieved 
for  complex  systems.  Since  that  time  reliability  growth  modeling 
has  been  viewed  as  a  useful  means  for  structuring  and  monitoring 
the  progress  of  development  programs.  While  a  large  number  of 
alternative  growth  models  have  been  proposed  (three  conceptually 
different  types  are  discussed  below),  the  "Duane  Model"  has  con¬ 
tinued  to  dominate  the  literature. 


1 .  The  Duane  Model 

The  Duane  model  assumes  a  linear  relationship  between  cumu¬ 
lative  failure  rate  and  test  hours  when  plotted  on  a  log-log 
grid.  Mathematically, 


e(t)  =  At~a 

when  c(t)  denotes  the  cumulative  failure  rate  of  the  system 
after  t  hours  of  testing,  a  is  a  constant,  usually  nonnegative, 
referred  to  as  the  "growth  rate,"  and  A  is  the  cumulative  fail¬ 
ure  rate  at  t  =  1  hour.  Letting  n(t)  denote  the  cumulative 
number  of  failures  up  to  time  t,  and  letting  i(t)  denote  the 
instantaneous  failure  rate  at  time  t,  by  definition 


i(t ) 


dn(  t ) 
dt 


and  it  is  easily  seen  that 


i(t)  =  ( l-o) At”a  =  (l-a)c(t)  . 

Thus,  the  instantaneous  failure  rate  is  proportional  to  the 
cumulative  failure  rate. 

In  practice,  the  constants  a  and  log  A  are  usually  esti¬ 
mated  from  reliability  data  plotted  on  a  log-log  grid  using 
standard  linear  least  squares  theory.  Alternative  estimators 
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have  been  derived  by  Crow  [13],  Donelson  [14],  and  others  under 
the  assumption  that  the  stochastic  process  underlying  the  data 
is  a  nonhomogeneous  Poisson  process.  Using  the  latter  approach 
to  analyze  reliability  data  from  270  electronics  equipment 
development  programs,  a  study  by  Hughes  Aircraft  [15]  found 
that  in  comparing  the  Duane  model  to  five  other  reliability 
growth  models,  the  Duane  model  nearly  always  fit  the  data, 
(according  to  goodness  of  fit  criteria  proposed  by  the  investi¬ 
gators)  and  was  the  best  model  overall,  although  in  many  specific 
cases  one  of  the  other  models  provided  a  better  fit. 

In  using  the  Duane  model  for  program  planning  and  manage¬ 
ment,  Selby  and  Miller  proposed  several  rules  of  thumb.  First, 
establish  a  program  goal  (reliability  prediction)  which  is  at 
least  125  percent  of  the  program  requirement.  Second,  take  as 
the  starting  (100  hour)  point  for  reliability  growth  a  cumula¬ 
tive  failure  rate  which  is  10  percent  (based  upon  empirical 
evidence  from  past  programs)  of  the  goal.  And  finally,  assume 
a  growth  rate  a  =  0.5  (based  upon  Duane's  empirical  observa¬ 
tions)  for  an  intense  reliability  effort.  The  result  is  an 
estimate  of  test  hours  required  and  a  growth  path  which  can  be 
used  as  a  yardstick  for  evaluating  program  progress.  In  a 
recent  application  of  RPM  to  an  avionics  equipment  development 
program,  Clarke  and  Cougan  [16]  concluded  that  RPM  was  a  useful 
approach  for  initial  test  duration  planning  purposes  and  for 
tracking  reliability  growth  during  the  middle  portion  of  the 
development  program.  During  the  early  stages  of  development, 
they  found  that  the  cumulative  failure  rate  was  too  sensitive 
to  individual  times  between  failure  to  enable  quantification  of 
the  growth  rate;  during  the  final  stages  of  the  development 
program,  the  cumulative  rate  incorporated  too  much  history  and 
did  not  react  quickly  enough  to  what  were  perceived  as  effec¬ 
tive  corrective  actions  for  failure  sources  uncovered  during 
the  program. 


5 


A  common  procedure  for  programs  in  which  several  differ¬ 
ent  types  of  testing  or  phases  are  scheduled  is  to  assume,  at 
least  for  initial  planning  purposes,  that  the  Duane  model  will 
be  applicable,  but  that  the  growth  rates  will  be  different  for 
the  different  phases.  The  growth  path  is  then  piecewise  linear 
on  a  log-log  grid,  specified  by  an  initial  cumulative  failure 
rate  together  with  the  sequence  of  growth  rates  and  durations 
of  the  various  phases.  Letting  t.  denote  the  test  time  at  the 

J 

end  of  phase  j,  c(t.)  denote  the  cumulative  failure  rate  at  the 

d 

end  of  phase  j  and  cij  the  assumed  growth  rate  throughout  phase  j, 
it  can  be  shown  that 


c(tj ) 


1-1,2, 


where  c(tQ)  and  tQ  are  specified  as  the  initial  cumulative  fail¬ 
ure  rate  and  the  initial  time  at  which  growth  rate  begins, 
respectively.  Given  c(tQ)  ,tQ  ,t^ , .  .  .  ,  and  the  growth  rates 
a1,a2,...,  the  cumulative  failure  rates  cCt^) ,c(t2) j • • • ,  and 
hence  the  growth  path,  can  be  determined. 


2 .  The  IBM  Model 

One  shortcoming  of  the  Duane  model  is  the  implication  that 
reliability  growth  can  continue  at  a  constant  rate  until,  in 
the  limit,  the  failure  rate  goes  to  zero.  By  adding  a  third 
unknown  parameter,  a  model  proposed  by  Rosner  [17]  removes  this 
deficiency  while  still  treating  test  time  as  the  variable  con¬ 
trolling  reliability  growth.  Rosner  assumes  that  the  system  to 
be  tested  has  both  an  inherent  (unknown)  failure  rate  A  and  an 
(unknown)  number  N  of  "nonrandom"  failure  modes  due  to  design 
faults,  manufacturing  errors,  workmanship  defects,  etc.  The 
removal  of  the  nonrandom  failure  modes  is  the  purpose  of  the 
development  test  program.  Letting  k(t)  denote  the  number  of 
such  modes  remaining  at  time  t,  Rosner  assumes  that  the  rate 
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of  change  of  k(t)  is  proportional  to  k(t),  that  is 


dk(  t ) 
dt 


-K-k(t)  , 


where  K  is  an  unknown  constant  of  proportionality.  Using  the 
fact  that  k(0)  =  N,  the  solution  to  the  above  equation  is 

k(t)  =  Ne'Kt  . 

Thus,  assuming  that  each  nonrandom  failure  mode  only  occurs 
once  before  being  corrected,  the  expected  number  F(t)  of  fail¬ 
ures  occurring  by  time  t  is  given  by 

F(t)  =  Xt  +  N-k(t)  -  Xt  +  N(l-e"Kt)  . 

The  latter  expression  can  be  fit  to  the  cumulative  failure  data 
using  a  nonlinear  estimation  algorithm,  yielding  estimates  of 
X,  N,  and  K. 

The  Hughes  study  [15]  mentioned  above  termed  this  model 
the  "IBM  Model"  and  found  that  it  outperformed  Duane  and  every 
other  model  tested  when  applied  to  reliability  growth  data  of 
airborne  electronics  equipment. 


3 .  The  LRU-Aqe  Growth  Model 

In  analyzing  failure  rate  data  of  electronic  line- 
replaceable  units  (LRUs),  Bezat,  et  al.  [18]  found  that  the 
mean  age  of  the  units  was  a  key  variable.  Program  data  con¬ 
cerning  a  Digital  Air  Data  computer  system  developed  by 
Honeywell  for  use  in  the  Douglas  Aircraft  Company's  DC-10 
aircraft  were  found  to  be  well  described  by  the  model 

X^^  =  K*  H_a  +  XR 

where 

X^  =  instantaneous  equipment  failure  rate 
K  =  constant 


H  =  mean  age  of  equipment  population 
a  =  growth  rate 

Ar  s  limiting  ("endless  burn-in")  failure  rate  . 

The  model  extends  the  concept  of  infant  mortality  throughout 
the  life  cycle  of  the  equipment  population — each  time  a  unit 
whose  age  is  less  than  that  of  the  population  average  fails, 
the  reliability  of  the  remaining  population  increases.  The 
authors  propose  using  the  model  as  a  management  tool  by  esti¬ 
mating  the  model  parameters  in  the  following  approximate  fashion. 
First,  obtain  estimates  for  K  and  a  by  fitting  a  line  to  a 
log-log  plot  of  failure  rate  versus  mean  equipment  age.  Second, 
assume  that  the  initial  (e.g.,  parts  count)  reliability  predic¬ 
tion,  say  A*,  holds  at  a  mean  equipment  age  of  1,500  hours. 

Then  the  difference  between  the  failure  rate  predicted  by  the 
fitted  line  at  1,500  hours  and  X*  yields  an  estimate  of  XR. 

No  relationship  between  resources  invested  and  reliability 
achieved  is  captured  by  the  model.  Furthermore,  one  possible 
problem  with  using  the  model  for  program  planning  is  the  impli¬ 
cation  that  for  a  fixed  number  of  test  hours,  the  greatest  reli¬ 
ability  improvement  is  achieved  with  the  fewest  number  of  test 
specimens . 

4 .  Limitations  of  Reliability  Growth  Models 

Reliability  growth  models  are  typically  simple  to  apply, 
recuire  minimal  da" a  at  an  aggregated  level,  and  enable  future 
prediction  of  whan  is,  at  best,  a  poorly  understood  quantity. 
However,  the  fact  that  all  of  the  above  models  fit  certain  sets 
of  data  reasonably  well  underscores  the  most  obvious  limitation 
of  such  models — they  are  based  upon  empirical  observations  and 
do  not  explain  why  the  data  behave  as  they  do.  Historical  evi¬ 
dence  from  similar  programs  provides  the  only  clue  as  to  which 
model  should  be  chosen,  if  any,  when  a  new  program  is  begun. 

A  second  limitation  concerns  the  time  frame  over  which  such 
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models  are  applied.  Typically,  reliability  growth  cannot  be 
modeled  until  end  product  testing  has  begun.  If,  from  that 
point  on,  the  growth  rate  is  slow,  then  it  is  the  starting  reli¬ 
ability  ( "of f-the-board" )  which  may  well  dominate  the  mature 
reliability  of  the  equipment.  In  fact,  the  starting  value  is 
itself  the  end  product  of  a  large  investment  of  resources,  yet 
growth  models  can  only  estimate  that  starting  value  after  ,the 
fact,  too  late  to  make  those  early  resource  allocations  which, 
most  authorities  agree,  have  the  most  leverage  over  reliability 
achieved.  In  the  electronics  equipment  area,  several  investiga¬ 
tions  have  been  published  regarding  the  effects  on  equipment 
reliability  of  alternative  resource  allocations  early  in  the 
development  phase.  Those  studies  are  discussed  next. 

C.  STUDIES  OF  ELECTRONICS  EQUIPMENT  RELIABILITY 
1 .  Defining  the  Costs  of  Reliability  Programs 

In  order  to  be  able  to  derive  a  functional  relationship 
between  reliability  growth  and  program  costs,  it  is  necessary 
to  be  able  to  define  the  latter  quantity.  That  is  not  an  easy 
task.  A  large  number  of  development  program  activities  impact 
reliability,  but  few  are  devoted  exclusively  to  reliability. 

Even  when  a  specific  reliability  program  is  not  part  of  the 
development,  a  certain  level  of  these  activities,  such  as  test¬ 
ing,  will  be  included.  Reliability  growth ,  therefore,  is 
related  to  a  cost  increment  above  what  the  same  program  would 
cost  in  the  absence  of  a  formal  reliability  effort.  In  the 
studies  described  below,  each  author  has  a  different  definition 
of  reliability  program  cost,  depending  upon  the  objectives  of 
his  study  and  the  limitations  of  the  accounting  systems  from 
which  his  data  are  derived.  A  paradigm  of  many  cost  models  and 
one  of  the  more  extensive  frameworks  for  defining  reliability 
program  cost  (for  electronics  equipment)  appears  in  a  paper  by 
Coppola  [191-  The  cost  is  divided  into  three  elements — materials, 
labor  (excluding  test  activity),  and  test  costs  (including  labor 
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and  failure  analysis) — which  are  in  turn  factored  into  a  large 
number  of  subelements  and  overhead  charges.  Material  cost  is 
primarily  the  cost  of  parts  screening.  Labor  excluding  test 
activities  includes  engineering  costs  (for  example,  including 
design,  parts  programs,  design  reviews,  etc.)  as  well  as  quality 
control  costs.  Test  costs  are  divided  into  the  various  types 
of  testing,  including  burn-in.  The  problem  with  the  model  from 
our  perspective  is  that  the  inputs  involve  a  circularity.  In 
order  to  specify  costs  of  failure  analysis,  for  example,  the 
equipment  and  subassembly  field  reliabilities  as  well  as  ratios 
of  development  reliabilities  to  field  reliabilities  are  required 
as  inputs.  The  latter  values,  however,  would  seem  to  depend 
upon  the  investment  in  reliability  which  is  the  output  of  the 
model . 

2 .  Reliability  as  a  Function  of  Program  Cost 

One  of  the  earliest  attempts  to  relate  reliability  achieved 
to  costs  of  development  activities  is  reported  by  Hevesch  [20]. 
Interested  In  effecting  marginal  improvements  to  "standard"  pro¬ 
grams  in  which  no  special  reliability  program  existed,  Hevesch 
viewed  reliability  testing  and  failure  analysis  as  necessary 
activities,  but  not  "primary"  reliability  Improvement  methods. 
The  latter  were  divided  into  three  categories: 

(1)  Reliability-Oriented  Design  Review  Activities 
(circuitry  simplification,  stress  reduction  through 
derating,  etc . ) 

(2)  "Ultra-Reliable"  Parts  Programs 

(3)  Introduction  of  Redundancy  into  Critical  Functions. 

In  terms  of  total  engineering  research  and  development  cost, 
Hevesch  found  that  total  reliability  program  costs  comprised 
between  two  percent  and  eight  percent  of  the  average.  Reli¬ 
ability  improvement  activities  constituted  5^  percent  of  the 
total  reliability  program  coses. 
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Working  with  data  from  four  system  development  programs, 
Hevescn  found  that  the  costs  for  each  of  the  above  activities 
increased  linearly  in  proportion  to  the  ratio  0/0q,  where  0 
is  the  MTBF  achieved  with  the  improved  design  and  0^  is  the 
MT3F  of  the  "standard"  design.  That  is,  treating  each  of  the 
activities  as  an  independent  contributor  to  reliability  improve¬ 
ment  of  the  system,  the  -cost  increment  resulting  from  applica¬ 
tion  of  the  itn  activity,  AC,.  ,  is  given  by 

AC.  =  K.  (/-  -  1) 

1  1  90 

for  some  constants  i=l,2,3*  Estimates  of  {K^}  and  asso¬ 
ciated  incremental  improvements  to  0Q  resulting  from  each 
activity  led  to  the  conclusion  that  the  second  activity, 
ultra-reliable  parts  program,  was  the  most  cost-effective 
improvement  method,  followed  by  redundancy.  Within  the  limits 
of  extrapolation  imposed  by  the  data,  the  author  estimated  that 
a  five  percent  cost  increment  over  the  engineering  development 
cost  of  a  "standard"  development  program  would  result  in  a  10 
to  12  percent  increase  in  MTBF.  A  suggested  percentage  alloca¬ 
tion  of  reliability  improvement  funds  to  the  three  activities 
is  also  given.  One  limitation  of  the  study,  recognized  by  the 
author,  is  that  the  computed  costs  of  the  reliability  improve¬ 
ment  methods  do  not  look  beyond  engineering  development.  For 
example,  increased  unit  production  costs  resulting  from  the  use 
of  ultra-reliable  parts  or  added  redundancy  are  not  considered. 

Similar  in  scope  to  the  Hevesch  study  (but  going  one  step 
further,  in  that  testing  is  also  considered  a  legitimate  reli¬ 
ability  improvement  parameter)  is  a  study  by  Mercurio  and  Skaggs 
of  General  Electric  [21].  The  objectives  of  this  study  were  to 
relate  equipment  reliability  achieved  to  total  reliability  pro¬ 
gram  element  costs,  and  to  quantify  the  incremental  improvements 
to  equipment  reliability  accruing  from  investments  in  various 
reliability  program  elements.  Reliability  program  elements 


11 


defined  by  the  authors,  slightly  different  from  the  defini¬ 
tions  of  Hevesch,  are  (in  chronological  order  of  occurrence): 


•  Design  Program  (including  reliability  predictions, 
failure  modes  and  effects  analyses,  design  reviews) 

•  Parts  Program  (screening,  standardization,  vendor 
control ) 

•  Testing  (evaluation,  environmental  screening, 

demonstration) .  ■* 

Using  data  from  the  development  program  of  10  elec¬ 
tronics  equipments,  the  authors  were  able  to  obtain  cost 
data,  expressed  in  mandays,  for  each  of  the  above  elements, 
as  shown  in  Table  1. 


Table  1.  RELIABILITY  ELEMENT  COST  DATA  (EXPRESSED  IN  MANDAYS) 
FROM  GE  STUDY  [21] 


Reliability 

Element 

Equipment  Letter  Code 

| 

B 

C 

D 

E 

F 

G 

H 

Hi 

K 

Design 

Program 

G,  330 

658 

893 

1,  427 

713 

2,  670 

675 

707 

Reliability 

Prediction 

3,  1G5 

1,036 

761 

452 

487 

649 

549 

207 

527 

544 

634 

4G0 

326 

206 

203 

131 

165 

594 

148 

163 

Reliability 

FMEA 

2,  531 

■ 

■ 

■ 

203 

650 

■ 

H 

— 

Parts  Program 

4,  027 

2,  174 

986 

2,  467 

1,  467 

1,  098 

5,934 

1,  042 

1,  142 

Test  Program 

5,094 

4,  458 

1,  332 

1,  989 

1,989 

834 

3,  343 

815 

946 

Total  R 

Program 

23,  449 

7,  719 

5,883 

5,  883 

11,947 
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Using  a  combination  of  available  data  and  engineering 
judgment,  the  authors  were  also  able  to  obtain  values  for 
system  mean  time  between  failures  for  each  of  the  equipments 
after  each  element  of  the  reliability  program  was  completed. 
The  relevant  quantities  are  defined  in  Figure  2,  taken  from 
the  study. 


9.  -  EFFECTIVE  ACHIEVED  MTBF  WITHOUT  RELIABILITY  PROGRAM 

9  -  EFFECTIVE  ACHIEVED  MT3F  RESULTING  FROM  RELIABILITY  DESIGN  PROGRAM 

d 

9p  -  EFFECTIVE  ACHIEVED  MTBF  RESULTING  FROM  DESIGN  PLUS  PARTS  PROGRAM 
»  (  *  9  p  MTBF  RESULTING  FROM  DESIGN  PLUS  PARTS  PLUS  TEST  PROGRAM 
. CORRECTIVE  ACTION  FEEDBACK  LOOPS 

Figure  2.  RELIABILITY  PARAMETERS  ESTIMATED  IN  [21] 


The  value  of  was  taken  to  be  the  value  computed  at 
the  completion  of  demonstrati tr.  tetti.ng.  Working  backwards, 
was  computed  by  evaluating  all  the  failure  modes  occurring 
during  testing.  3y  comparing  tr.e  tart  failure  rates  actually 
experienced  with  known  rates  f tr  similar  parts  procured  with 
no  particular  attention  given  to  the  achievement  of  high  reli¬ 
ability,  the  contribution  of  the  parts  program,  and  hence  9  , 
was  computed.  Finally,  9..  was  computed  for  each  equipment 
by  comparing  initial  designs  with  those  which  evolved  from 
the  reliability  design  program  effort.  The  computed  values 
for  those  parameters  are  shown  in  Table  2. 


1 


Table  2.  INCREMENTAL  EQUIPMENT  RELIABILITY  DATA  FROM  [21 


Equipment  Board  Design 

Letter  MTUF  MTI1F 


Off -the  Initial  *  Design  ♦  Design  ♦  Parts 


Parts 

MTBF 


►  Test 
MTBF 


Resultant 

Equipment 

MTBF 


14.2  1350.0 


8.7  225.0 


•COT,  LCL 


Multiple  regressions  were  run  for  both  the  MTBF  data  and 
Gain  data  of  Table  2  versus  the  costs  of  Table  1  and  the  parts 


counts,  Nnt,,  for  each  equipment.  The  MTBF  equations  tended  to 

r 


explain  the  data  better.  The  resulting  equations  are  as  follows 


9i  =  (1.06lxl04)/NpK0,921 


ed  =  0.211(9, 


0.956w„  0.300 


9p  =  0.585(9d1-134)(Cp°'185) 


9.  =  0.09M9o°'683)  (Ct0,741) 


n  p  h  t 

;  =  2  J  ’  c  1  > 
r  -)  ^  v  >  ^ 


I 


r* 

a 


O 


.1 


Gt  =  0.0064(Ct°' 952)  . 


Thus,  above  some  threshold,  testing  yielded  the  greatest  reli¬ 
ability  gain  per  unit  cost,  followed  by  design  activities  and 
finally,  parts  programs.  (This  is  just  the  opposite  finding 
from  Hevesch  regarding  the  last  two  elements.)  In  contrast  to 
the  findings,  the  average  actual  resource  allocations  from  the 
test  sample  were  approximately  22  percent  for  design,  40  per¬ 
cent  for  parts  programs,  and  38  percent  for  testing.  No  total 
test  hours  or  percentages  of  total  engineering  development  costs 
allocated  for  reliability  are  given,  so  a  comparison  of  the  over¬ 
all  reliability  efforts  involved  in  the  data  sample  programs  can¬ 
not  be  made  with  those  programs  used  to  provide  data  for  other 
studies.  One  final  remark  concerns  the  equation  for  given 
above.  This  equation  is  of  the  same  form  as  the  Duane  model, 
except  chat  the  parameter  is  test  cost  instead  of  test  hours. 

Only  if  C.  is  proportional  to  t  ( a//°  •  <^ )  for  SOme  value  of  a 
would  the  two  models  agree. 

Virtually  the  identical  methodology  was  used  in  a  study 
[22]  by  Schafer,  et  al .  at  Hughes  Aircraft  two  years  later. 
Whereas  Mercurio  and  Skaggs  focused  on  airborne  equipment,  the 
latter  study  focused  on  ground  electronics  equipment.  Again, 
the  authors  defined  three  reliability  program  elements — design, 
parts,  and  testing  (referred  to  as  "evaluation"  in  their  study) — 
obtained  costs  in  manaays ,  and  estimated  incremental  reliability 
gains  for  the  three  program  phases.  The  cost  and  gain  data, 
the  latter  shown  only  for  those  equipments  used  to  derive  the 
functional  equations,  are  given  in  Table  3.  In  comparing  Tables 
1  and  3,  note  that  the  Hughes  design  costs  (reliability-related 
only)  are  much  smaller;  the  parts  costs  are  about  the  same  in 
both  studies,  and  the  test  costs  are  also  somewhat  lower  in 
t he  H ughe s  study. 
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The  incremental  reliability  values  shown  in  Table  3.B  were 

obtained  by  working  backwards,  as  in  [21].  However,  both  9„ 

c. 


and  0p  were  obtained  by  fitting  "Duane"  lines  to  the  failures 
versus  test  hour  data.  The  final  instantaneous  values  so 


obtained  are  the  9r's  (except  in  two  cases  where  demonstrated 
values  were  used)  and  the  initial  computed  values  are  the  9p's. 
The  0^  values  were  found  as  in  [21].  The  estimates  of  9j' 
were  obtained  from  9^  by  assuming  that  the  design  gains  were 
equivalent  to  the  ratios  of  contractually  specified  MTBF's 
(demonstrated  by  all  but  one  of  the  equipments)  to  initial 
reliability  predictions  (made  prior  to  any  reliability  design 
effort ) . 

Schafer,  et  al. ,  analyzed  the  data  by  running  five  differ¬ 
ent  types  of  regression  models  on  124  different  variable  com¬ 
binations  including  those  shown  in  Table  3  plus  reliability 
specifications,  predictions,  and  equipment  parts  counts.  The 
results,  which  include  equations  estimating  program  element 
costs  as  a  function  of  the  latter  three  variables  as  well  as 
equations  expressing  reliability  gains  as  a  function  of 
resources,  can  obviously  not  be  presented  here.  However,  to 
compare  the  results  with  those  of  [21],  the  equations  for 
incremental  reliability  improvements  which  best  fit  the  data 


0D  =  4 . 9 4  (  9 


1.19 


-0.26' 


eP  =  0.l9(en1*15) (CD0,26) 


9„  =  13.64(0  °-0lUC,° 

n  r  n 


G„  =  0.27(CD°* 3U) 
G,  =  0.19(Cp0,29) 


3-  =  O.CCC029(CJ 


1.46  1.62  3.27  266.00  1.10  2.02  HI.  14  IH2  I'l 


With  me  exception  of  the  anomalous  equation  for  0^, 
apparently  driven  by  equipment  number  10,  and  the  weak  depen¬ 
dence  of  8„  on  8 p,  apparently  driven  by  equipment  number  6, 
the  equations  are  quite  similar  in  cost  exponent  magnitude  to 
those  of  [21]  given  above.  In  a  section  dealing  with  optimal 
allocation  of  a  fixed  oudgeo  of  development  program  resources, 
Schafer,  et  al .  concluded  that  within  the  bounds  defined  by 
me  data  set,  essentially  as  much  as  possible  ( 6 0  percent) 
should  be  spent  on  testing,  only  slightly  above  the  lower  bound 
on  parts  programs  (39  percent),  and  as  little  as  possible  on 
reliability  design  (1  percent).  Note  that  this  order  of  prior¬ 
ity  agrees  with  the  Hevesch  results. 

Soing  beyond  the  above  studies  to  incorporate  post¬ 
production  activities  is  a  model  proposed  by  Butler  [23]. 
Working  at  a  much  more  aggregated  level,  his  model  is  of 
the  form 

System  MTBF  =  MTBFp  ( R  ) ( Rm) ( Rf ) 

where  MTBF  is  the  initial  reliability  prediction  (9,  in  the 
P 

notation  of  [21],  R  is  a  factor  representing  the  total  effect 

S 

on  reliability  of  the  development  program  (i.e.,  collapsing  all 
of  the  reliability  elements  discussed  above),  represents  the 
manufacturing  influence  (process  control,  vendor  control,  burn- 
in  testing),  and  R^,  represents  the  combined  effect  of  the  field 
environment,  operator  skill  level,  logistics  support,  etc.  (R^ 
is  included  by  Butler  for  completeness  but  not  quantified). 
Butler’s  objectives  in  proposing  the  model  are  to  be  able  to 
(a)  maximize  system  reliability  for  a  fixed  production  cost, 
or  (b)  minimize  production  cost  for  a  fixed  reliability  con¬ 
straint,  and  in  conjunction  with  the  model,  he  presents  a 
framework  for  computing  the  unit  production  cost  in  terms  of 
the  reliability  parameters.  That  is,  much  like  the  cost  frame¬ 
work  proposed  by  Coppola  [19]  >  Butler  assumes  that  a  one-to-one 
correspondence  exists  between  the  vector  (MT3Fn,  R  ,  and  R^) 
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and  unit  production  cost,  and  the  latter  value  is  easily  deter¬ 
mined.  3efore  describing  his  model,  Butler's  paper  contains 
a  qualitative  discussion  of  the  most  notable  aspects  of  the 
reliability  portions  of  14  electronics  equipment  development 
programs.  Data  are  not  extrapolated  from  those  programs  in  a 
format  suitable  for  exercising  his  proposed  model,  although 
hypothetical  examples  are  given. 

Also  dealing  with  aggregated  data  from  both  development 
and  field  environments  is  the  study  by  Hughes  Aircraft  [15]. 

One  section  of  this  study  providing  a  comparison  of  several 
reliability  growth  models  was  discussed  briefly  in  Section  B 
above.  A  second  focus  of  the  study  was  an  attempt  to  compare 
the  dollars  invested  in  reliability  engineering  to  the  measured 
reliability  growth  of  the  270  equipments  comprising  the  data 
sample . 

All  programs  were  classified  as  belonging  to  one  of  three 
categories  of  reliability  "aggressiveness,"  as  determined  by 
their  levels  of  expenditures  in  reliability  engineering.  The 
categories  were  defined  as  follows: 

"Aggressiveness"  No.  of  Programs 

Category  Definition  in  Category 

HI  No  program  acquisition  costs  143 

expended  on  reliability. 

R2  Less  than  1  percent  but  more  60 

than  0  percent  of  total  pro¬ 
gram  acquisition  costs 
expended  on  reliability. 

33  .More  than  1  percent  of  total  67 

program  acquisition  costs 
expended  on  reliability. 

It  should  be  noted  that  not  all  of  the  270  programs  were  Hughes- 
developed  equipment  and,  in  classifying  those  programs  into  the 
above  categories,  a  specific  reliability  engineering  budget 
item  was  required.  If  none  was  found,  the  program  was  put  into 
category  HI.  Thus  it  is  possible  that  many  of  the  elements  of 
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a  reliability  program  (as  distinguished  from  a  "standard"  pro¬ 
gram  with  no  reliability  emphasis)  may  have  been  included  in 
some  of  the  R1  programs  provided  their  costs  were  allocated  to 
nonreliability  budget  items.  The  authors  do  indicate,  however, 
that  they  are  reasonably  confident  the  above  classification 
reflects  the  relative  emphasis  placed  on  reliability  during 
the  various  programs.  Also  note  that  the  overall  levels  pf 
expenditures  are  somewhat  lower  than  the  levels  (two  to  eight 
percent)  reported  by  Hevesch  [20]. 

In  addition  to  being  categorized  by  aggressiveness,  pro¬ 
grams  were  also  categorized  as  either  ground  equipment  or  air¬ 
borne  equipment.  Both  development  test  and  field  data  were 
carefully  filtered  to  remove  secondary  failures  that  were 
caused  by  other  relevant  failures. 

The  Duane  reliability  growth  model  was  used  in  all  cases, 
having  been  previously  determined  that  the  model  fit  all  the 
program  data  reasonably  well.  Reliability  growth  was  expressed 
as  both  a  rate  and  a  "gain."  The  rate  is  the  shape  a  of  the 
Duane  curve.  The  gain  is  defined  in  two  ways — 

rp  -  Observed  Final  Cumulative  MTBF 
^1  Calculated  Initial  Cumulative  MTBF 

rp  =  Calculated  Final  Cumulative  MTBF 
nu2  Calculated  Initial  Cumulative  MTBF 

and  represents  the  factor  by  which  the  "of f-the-board"  reliabil¬ 
ity  as  calculated  from  the  Duane  curve  (initial  estimates  were 
felt  to  be  too  arbitrary  to  be  used  directly)  had  been  improved 
through  reliability  growth. 

Table  4  summarises  the  study  findings.  As  one  might 
expect,  the  higher  the  level  of  reliability  expenditures, 
the  greater  the  growth  rate.  However,  the  reliability  gains 
were  larger  in  all  cases  for  level  of  expenditures  R2 .  This 
somewhat  surprising  finding  is  explained  by  the  authors  as 
follows : 
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The  larger  expenditures  concentrated  more  funds  in 
the  design  phase  (as  against  testing)  and  the  system/ 
equipment  was  probably  better  (less  design/workman¬ 
ship  faults)  when  testing  started  so  there  was  less 
gain  to  be  had  to  achieve  the  limiting  cumulative 
MTBF. 


Table  4.  RELIABILITY  GROWTH  VERSUS  RELIABILITY  ENGINEERING 
COST  FROM  HUGHES  AIRCRAFT  STUDY  [22] 


Reliability  Engineering 
Cost 

Category 

Average 

Rel iabi 1 i ty  Growth 
Rate3 

Average  Reliability  Gain 

Ground  Equipment 

Airborne  Equipment 

RG, 

RG, 

RG1 

RG2 

R] 

0.30 

3.88 

5.42 

3.09 

5.03 

R2 

0.37 

5.79 

9.98 

5.17 

7.65 

R3 

0.45 

4.02 

7.10 

2.17 

3.57 

3Combined  Ground  and  Airborne  Equipment 


Also,  many  cf  the  data  sets  were  borderline  between  categories 
R2  and  R3.  Nevertheless,  the  formulas  for  RG^  and  RG2  create 
a  clear  linkage  between  operating  hours,  growth  rate,  and  gain; 
implicit  in  the  findings  shown  in  Table  4  is  that  the  R3  pro¬ 
grams,  on  the  average,  had  fewer  operating  (test)  hours  than 
the  R2  programs. 

The  consistent  discrepancies  between  RG^  and  RG2  in  the 
Table  are  not  explained  by  the  authors,  but  would  indicate  that 
the  Duane  Curves,  which  yielded  the  numerator  of  RG2  and  denomi¬ 
nators  of  both  RG^  and  RG2>  were  consistently  overestimating 
reliability  in  the  later  stages  of  the  measurement  periods  for 
the  various  equipments.  The  smaller  gains  for  airborne  equip¬ 
ment  versus  ground  equipment  were  attributed  to  the  fact  that 
the  former  equipment  undergoes  more  environmental  and  screening 
tests  prior  to  final  assembly,  and,  therefore,  has  a  higher 
off-the-board  MTBF,  with  less  growth  potential. 
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Finally,  not  evident  in  the  Table  w as  an  additional  find¬ 
ing  concerning  development  versus  field  reliability  growth. 
"Gains"  during  development  were  found  to  be  approximately  twice 
as  large  as  gains  on  fielded  equipment,  and  the  development 
reliability  growth  rate  was  found  to  be  approximately  30  per¬ 
cent  higher  (a  =  0.36  versus  a  =  0.28)  than  that  for  fielded 
equipment . 

3 .  Designing  R&M  Programs  to  Minimize  Life  Cycle  Cost--the 
FAA  Approach 

The  above  studies  were  basically  concerned  with  making 
marginal  improvements  to  equipment  reliability  through  resource 
investments  in  selected  program  activities.  A  much  more  compre¬ 
hensive  objective  appears  in  a  paper  by  Lakner,  et  al.  [24], 
detailing  a  proposed  methodology  to  be  used  by  the  Airways 
Facilities  Service  of  the  Federal  Aviation  Administration  in 
procuring  National  Airspace  System  equipment.  The  objective 
is  to  establish  and  then  achieve  the  R&M  goals  which  minimize 
equipment  life  cycle  cost,  taking  into  account  the  contribution 
to  acquisition  costs  of  the  R&M  improvement  program.  The  reli¬ 
ability  improvement  contribution  stems  from  six  distinct  pro¬ 
gram  elements: 

•  Parts  Selection 

•  Derating 

•  Reliability  Growth  Testing 

•  Assembly  Screening 

•  Vendor  Surveillance 

•  Reliability  Program. 

The  first  three  elements  have  appeared  in  studies  mentioned 
above.  The  fourth  and  fifth  elements  represent  the  recogni¬ 
tion  that  a  decrease  in  reliability  generally  occurs  during 
the  transition  from  development  to  production.  Screening 
tests  (e.g.,  stress  testing)  eliminate  incipient  failures  from 
the  manufacturing  process,  and  vendor  surveillance  is  a  quality 


assurance  activity.  Finally,  the  sixth  element  aggregates  the 
overall  level  of  reliability  effort  and  program  emphasis  on  a 
qualitative  measurement  scale.  An  example  will  be  presented 
below . 

As  described  in  the  article,  the  authors  propose  a  three- 
stage  R&M  planning  process  which  appears  to  be  aimed  at  strik¬ 
ing  a  compromise  between  a  true  optimization  approach  and -an 
approach  which  is  implementable .  The  goal  of  the  first  stage 
is  to  obtain  a  functional  relationship  between  R&M  improvement 
activities  and  acquisition  costs.  The  process  is  illustrated 
in  Figure  3,  apparently  from  an  actual  case  study  by  the  authors 
though  presented  in  abstract  form  in  the  article.  Discrete 
levels  of  each  program  element  are  first  defined.  Next, 
selected  combinations  of  those  levels  are  used  to  define  alter¬ 
native  reliability  programs,  varying  from  all  elements  at  the 
lowest  level  (the  "standard"  program  in  our  previous  terminology) 
to  all  elements  at  the  highest  level  (the  "state-of-the-art"). 
Implicit  in  Figure  3*B  is  the  assumption  that  the  costs  and 
reliability  improvement  corresponding  to  each  of  these  levels 
can  be  quantified.  The  authors  suggest  simulation,  Duane 
growth  models,  etc.,  as  tools  for  obtaining  the  required  values. 
(Our  survey  of  previous  studies  above  suggests  that  the  neces¬ 
sary  data  and  methodology  may,  in  fact,  exist.)  Finally, 
plotting  the  values  so  obtained  allows  the  required  curve  to 
be  estimated.  Similarly,  a  curve  of  maintainability  improve¬ 
ment  (measured  in  terms  of  mean  time  to  repair)  can  be  obtained, 
after  adding  modularity  and  diagnostics  (e.g.,  built-in  test/ 
fault  isolation  test)  to  the  list  of  program  elements  with 
associated  discrete  levels  of  activity. 

The  second  stage  of  the  planning  process  uses  the  R&M 
acquisition  cost  versus  effectiveness  curves  to  minimize  the 
total  R&M  contribution  to  life  cycle  (acquisition  plus  O&M) 
cosos  over  the  range  of  possible  R&M  parameter  values.  The 
3&M  cost  contribution  can  be  obtained  from  standard  models 
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C.  Reliability  Improvement  Cost  Versus  Effectiveness  Curve 

Figure  3.  EXAMPLE  OF  FA A  METHODOLOGY  FOR  ESTIMATING  THE  COST 
OF  RELIABILITY  IMPROVEMENT  PROGRAMS,  FROM  [24] 

2  4 
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of  the  costs  of  corrective  maintenance  (including  spares),  pre¬ 
ventive  maintenance,  and  maintenance  training  as  a  function  of 
the  R&M  parameter  values.  In  principle,  once  this  minimization 
is  complete,  the  optimal  values  of  MTBF  and  MTTR  are  determined, 
and  the  program  yielding  those  values  can  be  implemented.  How¬ 
ever,  since  there  are  only  a  discrete  number  of  such  programs, 
none  of  which  may  correspond  to  the  optimal  parameter  values, 
a  third  stage  is  needed. 

The  third  stage  is  the  actual  test  planning  process.  As 
described  by  the  authors,  the  second  stage  above  is  used  to 
merely  ascertain  how  close  the  "optimal"  parameter  values  lie 
to  the  state-of-the-art  limits  (e. g. ,  9^  in  Figure  3).  Based 
on  their  proximity,  the  authors  suggest  how  tradeoffs  should  be 
made  between  growth,  demonstration,  screening  and  acceptance 
testing. 

Thus,  the  proposed  methodology  falls  short  of  the  "idealized" 
planning  loop  of  Figure  1,  but  is  much  more  ambitious  than  pre¬ 
viously  published  efforts.  One  notable  omission  from  the  approach 
is  the  possible  discrepancy  between  reliability  measured  during 
development  and  reliability  measured  in  the  field  (apart  from 
infant  mortality  or  quality  control  causes). 


4 .  Demonstrated  Versus  Field  Reliability 

A  number  of  studies  have  recognized  and  attempted  to  quan¬ 
tify  the  disparity  between  reliability  (MTBF)  measured  in  the 
field  and  reliability  demonstrated  or  predicted  during  develop¬ 
ment.  The  consensus  to  date,  however,  appears  to  be  that  a 
general  functional  relationship  does  not  exist,  and  the  most 
accurate  means  of  predicting  field  reliability  for  individual 
systems  is  to  obtain  field  data  for  similar  systems  in  similar 
operational  and  maintenance  environments. 


One  common  method  of  transforming  development  reliability 
to  field  reliability  is  the  "K-factor"  approach,  therein  the 
demonstrated/predicted  reliability  is  multiplied  by  a  number 
of  adjustment  ("K")  factors  to  account  for  definitional,  opera¬ 
tional,  and  environmental  differences  between  the  two  measure?. 
Shelley  and  Stovall  [25],  for  example,  define  15  such  factors. 
Using  data  on  35  equipments  from  the  C-5A  program,  those  authors 
selected  four  of  the  K-factors — (1)  ratio  of  unscheduled  removals 
to  verified  failures,  (2)  ratio  of  equipment  operating  hours  to 
flight  hours,  (3)  operating  environment  differences  (temperature, 
vibration  levels,  humidity,  etc.)  based  on  intuitive  engineer¬ 
ing  judgment,  and  (4)  ratio  of  total  laboratory  failures  to 
"chargeable"  (back  to  the  contractor ) /"relevant "  failures — to 
quantify  in  order  to  attempt  to  fit  equations  to  the  data.  The 
results  were  unsatisfactory.  While  it  was  concluded  that  the 
definitional  differences  (factor  (4)  above)  played  an  important 
role  in  explaining  the  discrepancies  between  the  development  and 
field  reliabilities,  the  adjusted  field  MTBFs  averaged  only  4? 
percent  of  the  demonstrated  MTBFs.  The  authors  did  not  obtain 
useful  predictive  equations,  and,  in  addition,  the  ranges  of 
values  of  the  K-factors  over  the  35  equipments  (1.0-1. 58,  0.05- 
2.63,  0. 5-2.0,  and  1.0-6. 0  for  factors  (1)  through  (4),  respec¬ 
tively)  imply  that  this  approach  cannot  be  generalized  beyond 
the  individual  equipment  levels. 

A  study  reported  by  Kern  [26]  concentrated  on  similar 
factors.  Working  with  historical  data  for  16  avionics  equip¬ 
ments,  the  raw  field  data  were  first  adjusted  for  definitional 
factors  (equipment  operating  hours,  failure  countability  cri¬ 
teria)  after  which  a  new  field  MTBF  was  computed.  The  applica¬ 
tion  of  this  definitional  adjustment  brought  the  average  ratio 
of  development  MTBF  to  field  MTBF  down  from  6:1  to  approximately 
2.4:1.  Kern  explained  the  remaining  discrepancy  in  terms  of 
operational  factors  (maintenance  handling,  utilization  rates, 
mission  durations,  etc.)  and  environmental  factors,  with  about 


half  of  the  discrepancy  explained  by  each.  However,  as  in  [24], 
the  range  of  field  to  development  ratios  was  large  (0.07-1.27), 
and  the  author  was  not  able  to  obtain  a  good  statistical  fit 
to  the  data.  One  interesting  finding  of  this  study,  however, 
which  may  help  in  part  to  explain  the  difference  in  adjusted 
field  versus  development  MTBFs  in  [25],  was  that  a  large  per¬ 
centage  (39  percent)  of  the  field  maintenance  actions  wer$ 
caused  by  equipment  interfaces. 

Finally,  a  study  by  Boeing  [27]  on  112  avionics  equipments 
comparing  raw  Air  Force  and  Navy  field  data  to  demonstrated/ 
predicted  MTBFs,  also  found  that  definitional  factors,  equip¬ 
ment  operating  hours  versus  flight  hours  in  particular,  were 
primary  contributors  to  the  discrepancies  between  the  two 
measures.  However,  over  a  wide  range  of  alternative  functional 
forms ,  a  statistical  model  explaining  the  observed  discrepancies 
could  not  be  found. 

Clearly,  if  field  reliability  cannot  be  predicted  from 
development  reliability  with  any  accuracy,  then  functional 
relationships  between  resources  invested  in  reliability  during 
development  and  development  reliability  achieved  cannot  be 
linked  to  mere  global  measures  of  cost-effectiveness  such  as 
life  cycle  cost  minimization .  Also,  if  the  interface  problem 
is  of  the  magnitude  implied  by  the  Kern  results,  then  it  may 
not  make  sense  to  separately  analyze  individual  equipments 
when  they  are  components  of  a  more  complex  system.  Neverthe¬ 
less,  prediction  of  field  reliability  from  development  reli¬ 
ability  should  not  be  an  intractable  problem,  and  more  analysis 
is  warranted  in  this  area. 

0.  STUDIES  OF  RELIABILITY  GROWTH  DURING  HELICOPTER 

DEVELOPMENT  PROGRAMS 

The  investigations  into  reliability  growth  of  electronics 
equipments  discussed  above  were  primarily  comparative  analyses 
of  histori:ai  data  with  the  objective  of  making  marginal 


improvements  to  a  methodology  for  developing  equipment  which 
is  apparently  well  understood,  at  least  at  an  intuitive  engi¬ 
neering  level.  Helicopters,  on  the  other  hand,  pose  a  more 
complex,  less  understood  problem  for  several  reasons.  First, 
historical  data  are  much  more  scarce.  Only  a  few  programs 
have  included  formal  reliability  efforts  during  development, 
and  those  are  too  recent  to  have  generated  studies  of  the. type 
discussed  above.  Second,  helicopters  are  composed  of  a  varied 
collection  of  complex  subsystems  that  are  themselves  the  sub¬ 
ject  of  an  intertwined  collection  of  development  programs.  The 
problem  of  reliability  apportionment — setting  intermediate  goals 
for  all  of  the  subsystem  reliabilities  such  that  the  total  sys¬ 
tem  goal  is  equaled  or  exceeded — must  be  addressed.  And  finally, 
there  is  an  extensive  menu  of  alternative  test  activities  from 
which  to  choose,  each  testing  some  subset  of  the  set  of  sub¬ 
systems  at  a  given  operating  rate  and  cost. 

The  studies  described  below  tend  to  focus  on  historical 
data  from  a  single  helicopter  type  in  order  to  derive  a  method¬ 
ology  for  planning  future  programs.  Also,  while  life  cycle 
cost  minimization  is  not  always  the  stated  objective,  the  reli¬ 
ability  parameter  of  interest  tends  to  be  mean  time  between 
removals  (MTBR) ,  historically  the  primary  driver  of  the  reli¬ 
ability  contribution  to  ownership  costs  of  fielded  systems. 

1 .  Reliability  Growth  Studies  by  Boeing  Vertol 

The  most  widely  quoted  study  concerning  the  tradeoff 
between  resources  involved  in  reliability  and  reliability 
achieved  for  helicopters  is  a  study  by  Rummel  [28],  with 
accompanying  volumes  by  Aronson  [29]  and  Jines  [30].  The 
objective  of  this  study  was  to  develop  a  methodology  for  for¬ 
mulating  cost-effective  reliability  test  programs  for  future 
helicopters,  given  the  contractual  numerical  reliability 
requirements.  Undertaken  in  advance  of  the  UTTAS  (Black  Hawk) 
program,  discussed  in  Chapter  II  below,  the  focus  of  the  study 


was  on  helicopters  in  the  15,000  lb.  gross  weight  class,  similar 
to  the  Black  Hawk.  Helicopters  in  the  90,000  lb.  class  were 
also  treated,  in  anticipation  of  a  possible  HLH  (Heavy  Lift  Heli¬ 
copter)  program,  although  the  latter  helicopter  was  the  subject 
of  a  follow-on  reliability  growth  study  to  be  discussed  below. 

The  Hummel  study  approach  was  to  first  use  historical  fail¬ 
ure  rate  (MT3R)  data  from  the  CH-^7  program  to  develop  a  list 
of  "off-the-bcard"  failure  modes,  with  associated  failure  rates, 
predicted  for  the  future  helicopter.  Second,  the  abilities  of 
different  types  of  testing  to  uncover  the  various  failure  modes 
were  estimated.  Finally,  various  combinations  of  those  tests 
were  compared  with  respect  to  both  cost  and  required  development 
program  duration  in  order  to  achieve  the  overall  reliability 
goal.  Demonstration  requirements  (objective,  duration,  consumer 
risk,  producer  risk)  were  treated  parametrically . 

Rummel  divided  the  various  kinds  of  reliability  tests  into 
five  general  types. 

(Type  I)  General  Design  Development  Tests  -  Those  tests  (stress, 
fatigue,  etc.)  which  support  the  design  by  aiding 
material  and  configuration  selection  and  component 
sizing.  Considerable  flight  testing,  such  as  struc¬ 
tural  demonstrations  as  well  as  testing  to  establish 
aircraft  load,  stability,  and  performance  character¬ 
istics,  falls  into  this  category.  These  tests  have 
very  specialized  objectives  and  are  not  typically 
reliability-oriented. 

(Type  II)  Reliability  Problem  Identification  Tests  -  These 
tests  (also  termed  "endurance,"  "qualification," 
or  "service"  tests)  are  designed  to  determine  the 
existence,  rate,  and  cause  of  reliability  problems 
and  whether  corrective  action  is  necessary  and/or 
effective.  Examples  of  these  tests  are  transmission 
bench  endurance,  rotor  whirl  tower,  tiedown,  and 


dynamic  system  tests.  Flight  testing  to  identify 
reliability  problems  also  falls  within  this  category. 


(Type  III)  Reliability  Problem  Investigation  Tests  -  Designed 

to  understand  field-identified  reliability  problems, 
these  tests  may  occur  during  either  the  development 
or  the  production  phase  of  a  program.  They  are 
specifically  designed  to  reproduce  certain  failure 


modes,  but  may  be  a  source  of  future  Type  II  tests. 


(Type  IV)  Reliability  Demonstration  Tests  -  The  objective  of 
these  tests  is  to  prove  to  the  customer  that  con¬ 
tractual  reliability  requirements  have  been  met. 
Usually  they  are  performed  by  flight  vehicles  In  the 
field  once  the  design  configuration  has  stabilized. 
Specifications  for  these  tests  are  in  the  form  of 
a  reliability  goal,  a  confidence  level  (level  of 
customer  risk)  at  which  that  goal  is  to  be  demon¬ 
strated,  and  a  duration  for  the  test.  Given  his 
level  of  risk  of  failing  the  demonstration,  the 
producer  can  determine  his  own  reliability  goal  for 
the  system  development  program. 


(Type  V) 


Production  Quality  Assurance  Tests  -  These  tests 
determine  if  the  reliability  level  has  been  main¬ 


tained  in  the  transition  from  development  to  pro¬ 


duction  hardware. 


Rummel  was  not  concerned  with  Type  I  tests  above.  He  considered 
the  costs  of  such  tests  to  be  fixed  and  (optimistically)  removed 
all  failure  modes  from  the  "of f-the-board"  list  which  he  felt 
would  be  uncovered  during  such  testing.  Thus,  "of f-the-board" 
defines  the  state  of  the  hardware  following  such  tests.  Type 
IV  and  V  tests  were  also  not  considered.  Other  assumptions 
underlying  Rummel' s  approach  are  as  follows: 

(a)  1,500  Type  I  flight  test  hours  are  included  in  all 
candidate  development  programs; 
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Co)  lead  times  and  operating  rates  of  the  various  test 
techniques  are  fixed; 

(c)  alternative  overall  test  program  durations  of  three, 
four,  and  six  years  are  examined  with  the  duration 
determining  the  number  of  test  rigs  and  test  articles; 

(d)  if  a  test  technique  is  capable  of  detecting  a  failure 
mode,  that  mode  will  occur  within  a  period  of  testing 
equal  to  twice  the  associated  MTBF; 

(e)  corrective  action  for  detected  failure  modes  is  ' 
immediate ; 

(f)  all  components  have  the  same  MTBR  goal,  chosen  such 
that  the  overall  system  MTBR  goal  (which  is  varied 
parametrically)  is  achieved;  and 

(g)  in  specifying  the  individual  test  durations,  the  test 
lengths  are  sized  to  the  lowest  component  MTBR  output 
(i.e.,  some  component  MTBR  levels  may  exceed  their  goals 
in  order  that  the  lowest  component  MTBR  just  meets  the 
goal) . 

The  costs  of  the  various  test  techniques,  assumed  operating 
rates  and  lead  times  are  shown  in  Table  5,  extracted  from  the 
study.  The  costs  as  shown  do  include  test  equipment  but  do 
not  include  the  cost  of  test  articles  (including  flight  test 
vehicles).  Also  not  included  are  the  costs  of  corrective 
actions  resulting  from  failure  mode  detections.  Rummel  did 
estimate,  however,  that  on  the  average  700  manhours  are  expended 
per  failure  mode  for  corrective  action.  The  high  cost  per 
flight  hour  for  Type  I  flight  testing  ($13,500  for  the  15,000 
lb.  helicopter)  is  due  primarily  to  engineering  and  manufactur¬ 
ing  support  labor  costs. 

It  is  impossible  to  reproduce  all  the  test  program  results 
of  the  study,  but  some  representative  findings  are  displayed  in 
Figure  4.  In  the  Figure,  "Demo-In"  and  "Demo-Out"  refer  to 
having  the  reliability  demonstration  during  development  or  after 
development,  respectively.  In  the  former  case,  the  time  interval 
for  problem  identification  testing  is  shorter  (one  year  less) 
than  in  the  latter  case,  and  the  cost  per  hour  of  demonstration 
testing  is  assumed  to  be  higher  (see  Table  5);  however,  the 
results  of  the  demonstration  are  known  prior  to  production. 
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Table  5.  RUMMEL  STUDY  TEST  COST,  OPERATING  RATE  SUMMARY 


Schedules 

CN-47 

Helicopter  "A" 

Helicopter 

Costs 

FY71  t) 

lead 

Oper 

lead 

Oper 

lead 

Oper 

technique 

CK-4/ 

nel (copter 

Helicopter 

-»-b 

{«.) 

(hr ./mo. ) 

(■>  1 

Ihr  /mo  1 

) 

(hr  /*n  ) 

'JH«  ! 

it  million) 

It  ■! 

Hon) 

(\  el  1 1  ton) 

fatigue  Motor  t.u«pon«nts 

3  46  " 

1  Oi  I 

4  19  " 

0.96 

0  67 

0.93 

{Detailed  schedules  are  not'reou'red 

to 

6  12 

$.4$ 

9.16 

derive  Type  1  ground  test  costs  ) 

fatigue  Drive  Lonponants 

1.56 

1  10 

3  10 

Static  Load 

o.uj 

0.31  j 

0.46  J 

Hiscel  la»-*owi 

(Gear  Resonance,  etc. ) 

0.35 

0.31 

0.48 

flight 

26.40 

20.30 

39.00 

26 

8 

24 

20 

26 

20 

(1.900  Might 

hours! 

<1,500  flight  hours) 

(1.500  flight  hours) 

ESI 

r 

Non* 

r 

Non- 

r 

Recurring 

recurring 

Recurring 

recurring 

Recurring 

Type  It 

■raca! 

(11.000) 

HI. 000) 

H/Xr.l 

Controls  8e«ch  Back-to-ftack 

44 

37 

94 

41 

211 

51 

6 

500 

6 

son 

6 

son 

Controls  Bench  Single  Spec l«en 

44 

37 

74 

37 

166 

46 

500 

6 

500 

6 

SUM 

f  ledcMi 

4.190 

2.200 

2.300 

1.700 

24 

16$ 

24 

165 

Oynamtc  Systems  lest 

N/A 

N/A 

2.020 

580 

N/A 

N/A 

20 

200 

Whirl  loner 

3.430 

6  SO 

2.580 

220 

6.187 

326 

16 

350 

20 

ISO 

22 

150 

Hub  Bearing 

24 

16 

N/A 

N/A 

144 

49 

6 

500 

1/A 

N/A 

9 

400 

Transmission  Open  loop 

2.284 

JS4 

21 

350 

•  • 

Tall  Rotor  whirl  loner 

It/A 

N/A 

330 

no 

N/A 

N/A 

N/A 

N/A 

16 

400 

ft/ A 

N/A 

Flight 

A/ A 

N/A 

2.500 

4.630 

N/A 

N/A 

24 

70 

26 

70 

(yp* .IV 

flight  (Development  Phase! 

. 

2.500 

N/A 

SO 

40 

flight  (Operational  Phase} 

200 

' 

200 

N/A 

50 

40 

4IS.l)0U  lb.  gross  weight  single  rolor 
D 90. UOO  lb.  gross  MM9M  tnnKw  rotor 


MTBR*  denotes  the  reliability  goal  to  be  demonstrated  at  the 
indicated  confidence  (customer  risk)  level.  The  producer  risk 
is  always  taken  to  be  80  percent.  Note  from  the  Figure  that 
the  Type  I  test  costs  (assumed  fixed)  always  exceed  the  problem 
identification  test  costs,  even  at  the  most  demanding  demon¬ 
stration  level.  Other  conclusions  of  the  study  include: 

•  Of  the  cost  variables  studied,  the  demonstration 
approach  (demo-in  or  demo-out)  and  the  reliability 
levels  to  be  demonstrated  have  a  greater  cost  impact 
than  the  mix  of  techniques  used  in  the  program  or  the 
elapsed  time  of  the  program. 
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(A)  Demonstration  Test 

(B)  ProOlem  Identification  Test 

(C)  Corrective  Action  and 

Environmental  Tests 

(D)  Type  I  Ground  Tests 

(E)  Type  I  Flight  Tests 


,(0 - 

(D)  I  (0) 


Demonstration  Approach 

Demo- In 

Demo- In 

Demo-Out 

Demo-Out 

Demo- Out 

MTBR*  (Hours (/Confidence  (%) 

1 .000/90 

1.500/90 

1,500/90 

1  ,500/30 

500/30 

Elapsed  Time  (Tears) 

4 

4 

4 

4 

6 

Required  MTBR  Achieved  (Hours) 

3.000 

4,750 

3.000 

1,900 

590 

Demonstration  Ouration  (Hours) 

5.500 

9,000 

25,000 

2,400 

1,500 

Figure  4 . 

RUMMEL 

STUDY 

[28]  SAMPLE 

RESULTS 

•  Once  the  length  of  the  program  is  fixed,  the  program 
cost  is  relatively  insensitive  to  the  mix  or  operating 
rates  (varied  as  an  excursion)  of  the  various  test 
techniques . 

•  Broader  consideration  of  design  effort,  reliability 
apportionment,  acquisition  costs  and  O&M  costs  in 
the  context  of  life  cycle  cost  minimization  would 
be  desirable  in  future  studies  of  this  kind. 

Concerning  the  study  assumptions  listed  above,  assumptions 
(d)  and  (e)  are  particularly  critical  in  driving  the  study 
results,  in  drawing  comparisons  between  this  study  and  other 
helicopter  studies  to  be  discussed  below,  and  in  comparing 
pre-production  versus  post-production  reliability  programs. 

For  example,  one  additional  finding  of  the  Hummel  study  is 


that  there  is  a  direct  relationship  between  a  percentage  change 
in  test  program  cost  and  a  percentage  change  in  the  number  of 
of f-the-'ooard  failure  modes  present.  That  is,  if,  for  example, 
the  of f-the-board  MTBR  is  doubled  by  doubling  the  number  of 
failure  modes  (keeping  the  distribution  fixed),  then  the  test 
costs  will  double.  To  compare  this  finding,  with,  say,  the 
Duane  reliability  growth  model,  the  latter  requires  a 
increase  in  test  time  for  each  doubling  of  the  initial  failure 
rate.  For  a  Duane  growth  rate  a  ■  0.5,  a  fourfold  increase  in 
test  time  is  thus  implied;  for  a  growth  rate  a  -  0.20,  similar 
to  those  measured  for  recent  helicopter  development  programs 
discussed  in  Chapter  II  below,  a  32-fold  Increase  is  implied. 
Assumptions  I'd)  and  (e)  also  imply  that  more  attention  than 
might  be  justifiable  should  be  paid  to  low  frequency  (high  MTBR) 
failure  modes  since  those  drive  the  test  size/duration  require¬ 
ments,  and  that  shorter  calendar  time  development  programs  are 
less  costly  relative  to  longer  calendar  time  development  pro¬ 
grams  than  they  might  be  if  failures  were  not  detected  and 
corrected  so  quickly.  In  [30],  sensitivity  analyses  to  (d) 
and  (e)  confirm  this  fact,  indicating  as  shown  in  Table  6  that 
program  cost  also  increases  in  proportion  to  corrective  action 
efficiency.  (Thus  a  Duane  a  of  0.5  corresponds  to  a  4  x  MTBR 
corrective  action  efficiency  in  the  Rummel  study.)  Finally, 
assumptions  (f)  and  (g)  indicate  that  the  reliability  apportion¬ 
ment  problem — optimal  allocation  of  component  MTBR  goals  to 
minimize  the  cost  of  achieving  the  overall  system  goal — was  not 
considered.  For  that  reason,  and  because  only  a  small,  heuris- 
ticaily  determined  subset  of  possible  test  programs  was  evalu¬ 
ated,  neither  the  methodology  nor  the  results  are  "optimal'' 
in  a  formal  sense. 

A  follow-on  study  dealing  with  the  HLH  by  Burden  [31] 
carried  the  Rummel  approach  one  step  further  by  incorporating 
04M  costs  into  the  analysis.  The  objectives  of  the  Burden 
study  were  to  (a)  determine  the  relationship  between 
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reliability  and  life  cycle  cost,  (o)  design  a  test  program  to 
minimize  development  plus  O&M  costs,  and  (c)  identify  the  most 
cost-effective  reliability  requirement  for  the  HLH.  Burden 
considers  27  separate  HLH  components;  the  parameter  of  interest 
is  MTBR. 


The  distribution  of  failure  modes,  the  of f-the-board  MTBRs , 
the  effectiveness  of  the  various  test  techniques,  test  costs 
and  operating  rates  are  all  taken  or  extrapolated  from  the 
Rummel  study-  Test  programs  are  proposed  which  achieve  various 
alternate  levels  of  initial  production  aircraft  reliability. 

The  fleet  life  cycle  is  simulated  using  a  Monte  Carlo  model. 
Fleet  sizes  of  50,  100,  and  200  aircraft  with  utilization  rates 
of  30  hours  per  month  and  60  hours  per  month  are  evaluated. 
Additional  study  assumptions  include  the  following: 

(a)  An  extensive  component  development  (Type  I  test)  pro¬ 
gram  including  the  fabrication  of  one  flying  prototype 
and  100  hours  of  flight  testing  are  assumed  to  have 
occurred  prior  to  this  study.  The  costs  of  this  pro¬ 
gram  are  considered  sunk. 

(b)  No  calendar  constraints  are  placed  on  the  development 
program  (keeping  the  number  of  test  rigs/articles  to 
a  minimum) . 

(c)  Corrective  action  efficiency  during  development  is  2  x 
(component  MTBR)  to  detect  and  fix  each  failure  mode. 

(d)  The  production  rate  is  two  aircraft  per  month.  The 
fleet  life  is  10  years  following  the  last  production 
aircraft . 

(e)  Reliability  growth  continues  throughout  the  useful 
life  of  the  fleet.  Corrective  actions  on  fielded 
systems  (ECPs)  are  assumed  to  be  initiated  after  15 
occurrences  of  each  failure  mode  and  then  require 
three  years  to  be  implemented. 

(f)  No  discounting  is  used  in  computing  O&M  costs. 

Findings  and  conclusions  of  the  study  include  the  follow- 


•  "Optimal"  development  test  program  costs  are  approxi¬ 
mately  equal  to  the  fleet  lb-year  O&M  costs,  as  shown 
in  the  following  sample  results  spanning  the  range  of 
alternatives  investigated: 
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Fleet  Size  Utilization 


Test  Program  Cost 
(FY73  S  Millions) 


50  30  hrs. /month  33-5 

200  60  hrs. /month  69.0 


•  The  test  program  costs  break  down 


Fleet  10-Year 
O&M  Cost 

(FY73  $  Millions) 

34.5 

53.0 

into 


Flight  Tests  25%  -  30% 

Other  Tests  25%  -  35% 

Corrective  Actions  35%  -  50% 

•  The  "optimal"  reliability  requirement  is  quite  sensi¬ 
tive  (the  ratio  of  the  lowest  to  highest  value  is 
about  2.5)  to  fleet  size  and  utilization,  driven 
primarily  by  the  spares  component  of  the  O&M  cost. 

•  Life  cycle  costs,  however,  are  not  sensitive  (within 
a  range  of  say  +50  percent)  to  achievement  of  the 
optimal  reliability  requirement.  The  assumption  of 
reliability  growth  in  the  field  mitigates-  the  increase 
in  O&M  costs  resulting  from  poorer  initial  reliability 


•  Under  the  assumption  of  no  reliability  growth  in  the 
field,  the  optimal  reliability  requirement,  as  well  as 
the  minimum  life  cycle  costs  and  corresponding  develop 
ment  and  O&M  costs,  all  increase  by  about  30  percent. 
Also,  the  sensitivity  of  life  cycle  cost  to  reliabil¬ 
ity  requirements  increases  substantially. 


2 .  Reliability  Growth  Studies  by  Sikorsky 

In  parallel  with  the  Rummel  study,  three  authors  at 
Sikorsky  Aircraft  were  also  investigating  the  relationship 
between  reliability  objectives  and  development  program  costs 
for  helicopters  of  approximately  15,000  lb.  The  Sikorsky  study 
[32]  is  more  qualitative  than  the  Rummel  study  and  more  closely 
tied  to  historical  data,  perhaps  because  the  H-3  helicopter 
program  from  which  those  data  were  taken  involved  a  17,000  lb. 
single  rotor  helicopter,  very  similar  to  the  hypothetical  heli¬ 
copter  of  interest. 

The  Sikorsky  study  consists  of  several  loosely  related 
sections.  One  section  compared  the  relative  frequencies  of 
failure  mode  occurrences  for  H-3  rotor  systems  and  transmis¬ 
sion  systems  during  development  versus  in-field  use.  The 


investigation  found  large  discrepancies  between  those  fre¬ 
quency  distributions.  For  example,  bearing  failures  accounted 
for  approximately  50  percent  of  the  main  gearbox  development 
failures  but  only  13  percent  of  the  field  failures.  On  the 
other  hand,  almost  half  of  the  field  failures  could  only  be 
categorized  as  "miscellaneous,"  versus  only  seven  percent  of 
tne  development  failures.  Leaking  seals  accounted  for  a  high 
percentage  of  the  field  failures  of  both  the  intermediate  and 
tail  gearboxes,  and  both  the  main  and  tail  rotor  heads;  such 
leaks  were  a  minor  source  of  failures  during  development. 
Absolute  differences  between  failure  rates  during  development 
and  in  the  field  were  not  compared.  The  authors'  purpose  in 
comparing  relative  frequencies  was  to  ascertain  whether  changes 
to  the  H-3  development  test  program  were  warranted  in  design¬ 
ing  a  program  for  the  new  helicopter.  While  many  of  the 
observed  discrepancies  in  the  frequencies  can  be  attributed 
to  corrective  actions  made  during  development,  the  authors 
did  conclude  that  more  environmental  conditions  needed  to  be 
simulated  during  the  qualification  segment  of  the  test  program. 

A  second  section  of  the  study  deals  with  accelerated 
(overload)  testing.  A  qualitative  discussion  of  the  philosophy 
of  employing  accelerated  loads  and  the  potential  calendar  time 
reductions  in  the  development  program  is  presented. 

The  main  section  of  the  study  deals  with  the  test  cost 
versus  reliability  achieved  issue.  The  authors  propose  a  five- 
year  development  test  program  (including  the  reliability 
demonstration),  chosen  from  four  variations  of  the  H-3  devel¬ 
opment  program  and  incorporating  the  environmental  testing 
discussed  above  (but  no  accelerated  loads).  The  reliability 
parameter  of  interest  is  again  MTBR,  although  the  focus,  for 
demonstration  purposes,  appears  to  be  only  on  the  combined 
MTBR  of  the  transmission  system  and  rotor  system  components. 
Three  such  MTBR  values — 500,  1,000,  1,500  hours — and  three 
demonstrated  levels  of  confidence  (customer's  risk)--30,  60, 


-»  Q 

to 


90  percent; — are  examined.  The  study  does  not  trade  off  dif¬ 
ferent  mixes  of  tests  in  the  manner  that  Rummel  did.  Instead, 
one  duration  is  chosen  for  each  MTBR  and  confidence  level 
demonstration,  which  implies  an  MTBR  to  be  developed  (to 
satisfy  the  producer's  risk  criteria),  which  in  turn  implies 
a  certain  amount  of  component  testing.  Since  the  mix  of 
testing  is  fixed,  the  five-year  calendar  time  constraint  • 
together  with  test  operating  rates  force  a  certain  number  of 
test  specimens,  and  the  test  cost  can  be  determined. 

The  costs  and  operating  rates  of  testing  are  quite 
similar  to  those  given  in  [28]  and  are  reproduced  here  in 
Table  7  for  possible  future  reference.  Unlike  Rummel' s  study, 
however,  the  effectiveness  of  testing  is  presented  in  a  manner 
that  is  component  oriented  rather  than  test  oriented.  That 
is,  Rummel  estimated  the  capabilities  of  each  testing  tech¬ 
nique  for  detecting  failure  modes  exhibited  by  all  components 
of  the  helicopter.  The  Burroughs,  et  al.  study  estimates 
the  rapidity  with  which  the  failure  rate  of  each  component 
will  be  improved  as  it  undergoes  the  given  mix  of  tests.  One 
interesting  finding  of  the  latter  study  is  that  after  the 
first  3,000  test  hours  have  elapsed,  during  which  time  little 
improvement  in  component  failure  rate  occurs,  the  rate  of 
such  improvement,  expressed  as  a  percent  of  the  of f-the-board 
failure  rate  is  linear  in  test  hours.  (However,  this  finding, 
while  not  explained  in  detail  in  the  study,  appears  to  be 
based  on  the  comparison  of  H-3  failure  modes  detected  during 
development  testing  with  the  duration  of  that  testing.  The 
contribution  of  failure  modes  detected  subsequently  on  fielded 
aircraft  to  the  test-effectiveness  graphs  presented  in  the 
paper  is  not  clear. )  xne  conclusions  of  the  study  are  pre¬ 
sented  graphically,  as  development  cost  versus  time  curves 
for  each  demonstration  requirement.  In  all  cases,  costs 
tend  to  increase  rapidly  for  the  first  one  and  one-naif  years 
until  all  test  facilities  are  complete,  and  then  at  a 

39 


decreasing  rare  until  the  demonstration  requirements  have 
been  met.  The  final  program  costs  are  summarized  in  Table  8. 


Table  8.  BURROUGHS,  ET  AL.  [32]  DEVELOPMENT  TEST  COSTS 
VERSUS  DEMONSTRATION  REQUIREMENTS  (EXPRESSED 
IN  FY 7 1  S  MILLIONS) 


Demonstration 

Requirement 

(MTBR) 

CONFIDENCE 

LEVEL  TO  BE  DEMONSTRATED 

">) 

30 

60 

90 

_ 

Test 

Cost3 

Test  Cost 
Plus 

Demo  Cost 

Test 

Cost 

Test  Cost 
Plus 

Demo  Cost 

Test 

Cost 

— 

Test  Cost 
Plus 

Demo  Cost 

500  hrs. 

5.7 

5.6 

6.3 

5.9 

7.8 

1000  hrs. 

6.8 

8.9 

10.0 

10.9 

13.2 

1500  hrs. 

11.5 

11.7 

13.9 

U.5 

17.4 

aCosts  in  this  Table  do  not  include  flight  testing  or  costs  of  aircraft 
parts  except  for  tiedown  vehicle(s)  at  one  million  per  vehicle. 


Note  that  a  tripling  of  the  MT3R  requirement  results  in  roughly 
only  a  doubling  of  the  total  development  test  costs  (and  even 
a  smaller  multiplier  if  flight  testing  costs  are  incorporated 
into  the  test  program  at  a  constant  level  for  all  demonstra¬ 
tion  requirements).  In  view  of  our  discussion  above  concerning 
the  effects  of  corrective  action  assumptions  on  the  Rummel 
study  results,  this  would  appear  to  be  a  very  optimistic  find¬ 
ing.  It  may  be  related  to  the  fact  that  the  demonstration 
requirement  appears  to  be  restricted  to  the  transmission  and 
rotor  system,  and  is  certainly  related  to  the  linearity  in 
test  hours  of  test  effectiveness  as  noted  above.  Detailed 
comparisons  between  the  Rummel  and  Burroughs  findings  are 
impossible  for  a  number  of  reasons: 

(1)  In  1 32]  no  distinction  is  drawn  between  Type  I  and 
Type  II  testing.  All  such  testing  appears  to  be  a 
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legitimate  variable  in  designing  a  test  plan  to  meet 
a  reliability  goal,  and  the  costs  of  all  such  testing 
were  included  in  the  results  shown  in  Table  8.  This 
reemphasizes  a  point  made  in  discussing  electronics 
studies  above — it  is  very  hard  to  determine  what  costs 
are  attributable  to  an  R&M  program;  not  only  do  dif¬ 
ferent  programs  put  forth  different  definitions  of 
how  reliability  should  be  measured,  as  will  become 
apparent  in  subsequent  chapters  of  this  paper,  but 
different  contractors,  both  philosophically  and  in  an 
accounting  sense,  have  different  definitions  of  what 
constitutes  reliability  cost. 

(2)  While  [28]  includes  the  reliability  improvement  (but 
not  the  cost)  accruing  from  1,500  hours  of  flight  tests 
in  each  proposed  development  program  plus  both  the  cost 
and  effect  of  additional  flight  testing,  [32]  viewed 
flight  testing  as  being  related  only  to  performance 
and,  hence,  none  was  included. 

(3)  In  [32],  all  demonstrations  are  assumed  to  be  accom¬ 
plished  in  ground  tests,  while  flight  testing  Is  used 
in  [28].  As  a  result,  in  the  latter  study  boti.  the 
magnitude  and  relative  sensitivity  of  test  costs  to 
demonstration  requirements  are  much  greater. 

While  both  [32]  and  [28]  were  completed  just  prior  to  and 
ticipation  of  the  development  program  for  the  Utility 
cal  Transport  Aircraft  System  (UTTAS — later  the  Black  Hawk), 
cod  Sikorsky  study  [33]  was  published  shortly  before  the 
eticr.  of  that  development  program.  Although  much  more 
•:  in  scope,  concentrating  on  detailed  helicopter  drive 
••  :-:igr.  considerations ,  the  latter  study  is  of  interest 

-  >:t  of  this  chapter  for  several,  reasons.  First, 

■ :e  ller.t  guide  to  applying  the  Hummel  approach 
.---referred  to  here  as  "Generalized  Test  Flan- 
c  .•■.at  method  is  essentially  repudiated 
a  o 
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on  the  grounds  that  (a)  too  many  poorly  understood  quantitative 
assumptions  are  required,  and  (b)  it  may  not  be  easily  adapted 
to  new  test  techniques  or  advances  in  technology,  such  as  new 
types  of  structural  materials,  which  may  eliminate  whole  classes 
of  failure  modes,  but  also  introduce  new  ones.  Advocated 
instead,  at  least  for  helicopters  like  the  Black  Hawk,  are 
programs  patterned  on  the  UTTAS  drive  system  development  tests, 
presumably  arrived  at  through  more  heuristic  application  of 
engineering  experience,  on  the  grounds  that  the  latter  program 
was  highly  successful.  Second,  going  back  early  in  the  design 
phase  of  a  new  system,  one  objective  of  [33]  was  to  attempt  to 
relate  numerical  reliability  requirements  to  engineering  design 
parameters  such  as  stresses  or  bearing  lives.  The  attempt  was 
unsuccessful,  because  sufficient  data  did  not  exist  for  estab¬ 
lishing  failure  rates  over  time  (hazard  functions)  for  individ¬ 
ual  failure  modes  of  components,  and  because  techniques  of  engi¬ 
neering  analysis  were  not  sufficiently  evolved  to  enable  deter¬ 
mination  of  those  engineering  parameters  acting  on  the  component 
at  any  given  time.  Thus,  while  such  indicators  as  parts  counts 
appear  to  lead  to  reasonable  reliability  predictions  for  elec¬ 
tronics  equipment,  the  authors  of  [33]  concluded  that  accurate 
reliability  predictions  for  helicopter  transmissions  (and  pre¬ 
sumably  for  other  complicated  systems)  are  impossible,  and  high 
reliability  of  such  systems  should  be  a  by-product  of  "currently 
accepted  design  practices"  rather  than  the  explicit  output  of 
specific  reliability  design  activities.  Finally,  turning  to 
the  timing  of  reliability  demonstrations,  the  authors  felt  that 
they  must  be  dene  in  the  field.  Development  testing  cannot 
reveal  many  field  failure  modes;  quality  control  problems  intro¬ 
duce  a  large  number  of  failure  modes  into  production  units;  and 
the  costs  tc  fabricate  a  statistically  meaningful  sample  of 
demonstration  test  specimens  are  prohibitive.  Quantitative 
resource  considerations  or  comparisons  of  development  versus 
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Reliability  Growth  Stud' 


He! i copter 


Historical  data  from  early  production  years  of  the  UH-1D 
and  AH-1G  programs  were  used  in  a  reliability  growth  study  by 
Conway  [3*0.  The  objective  was  to  determine  those  relation¬ 
ships  between  reliability  growth  characteristics  and  program 
parameters  which  might  be  useful  in  planning  future  develop¬ 
ment  programs.  Although  neither  the  UH-1D  nor  the  AH-1G 
had  formal  reliability  programs  during  development  (the  author 
originally  attempted  to  track  reliability  growth  versus  devel¬ 
opment  test  hours  but  concluded  it  was  impossible),  both  heli¬ 
copters  underwent  "M&R"  programs  early  in  their  production 
phases  during  which  extensive  reliability  and  corrective  action 
data  were  collected.  Data  were  available  on  five  fiscal  year 
configurations  of  the  UH-1D  (FYS2  through  FY66)  monitored  during 
the  M&R  program,  plus  three  additional  configurations  (FY6? 
through  FY69)  on  which  the  effectiveness  of  corrective  actions 
initiated  during  the  M&R  program  could  be  assessed.  For  the 
AH-1G,  three  fiscal  year  configurations  were  monitored  during 
the  M&R  program  ( FY 66  through  FY68),  plus  additional  data,  which 
were  available  on  FY69  and  FY7Q  models.  The  durations  of  the 
two  M&R  programs  and  total  flight  hours  monitored  were  39  calen¬ 
dar  months  and  50,000  flight  hours  for  the  UH-1D,  and  29  calendar 
months  and  66,000  flight  hours  for  the  AH-1G.  Some  aircraft 
were  dropped  from  the  data  sample  due  to  missing  or  suspect  data. 
Also,  although  both  the  UH-1D  and  AH-1G  evolved  from  the  same 
parent  aircraft — the  UH-1A — differences  were  minimized  by  delet¬ 
ing  data  on  systems  not  critical  to  flight,  such  as  communica¬ 
tion,  navigation,  and  weapons. 


The  methodology  used  by  the  author  for  both  helicopter 
types  began  with  the  construction  of  a  baseline  system  failure 
rate,  composed  of  the  failure  rates  (computed  from  the  data) 
for  all  those  failure  modes  observed  in  the  data  base  for 
which  reliability  improvements  (corrective  actions)  were  not 
experienced.  The  remaining  failure  modes  each  had  two  failure 
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rates  associated  with  them — a  failure  rate  Aq  prior  to  imple¬ 
mentation  of  corrective  action  and  a  failure  rate  A ^  following 
implementation.  In  all  cases  A^  was  less  than  Aq,  and  in  those 
cases  where  no  failures  were  observed  between  corrective  action 
implementation  and  termination  of  the  data  collection  period, 

A ^  was  (optimistically)  taken  to  be  zero.  Finally,  an  annual 
system  failure  rate  for  each  helicopter  type  was  constructed 
by  adding  to  the  baseline  failure  rate  either  A^  or  A^,  for 
each  ccrrected  failure  mode,  depending  upon  whether  or  not 
corrective  action  had  been  implemented  prior  to  the  start  of 
that  fiscal  year. 

During  the  M&R  programs,  seven  occurrences  of  a  failure 
mode  were  required  for  corrective  action  initiation  (except 
for  failures  affecting  safety  of  flight). 

The  author  compares  failure  rate  growth  for  both  calendar 
time  and  cumulative  M&R  program  flight  hours.  Conclusions  of 
the  study,  and  some  comparisons  with  other  studies  discussed 
above,  include  the  following: 

(1)  The  relationship  of  reliability  growth  to  cumulative 

flight  hours  is  shown  in  Figure  5  taken  from  the  study. 
The  data  are  plotted  on  a  log-log  grid  in  order  to 
compare  the  results  with  Duane/RPM  methodology.  From 
the  Figure,  the  author  concluded  that  the  time  lag 
in  implementing  corrective  actions  on  production  air¬ 
craft  caused  the  piecewise  linearity  of  the  growth 
curves,  although  once  that  time  lag  was  overcome, 
straight  lines  appeared  to  fit  the  remaining  data 
points  well.  The  author  found  the  "of f-the-board" 
mean  times  between  failure  to  be  between  20  and  35 
percent  of  the  estimated  mature  program  values — much 
higher  than  the  RPM  "10  percent"  rule-of-thumb , --a 
fact  which  he  attributed  to  the  "flight-quality" 
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Fiqure  5.  BELL  STUDY  [34]  UH-1D  AND  AH- 1 G  RELIABILITY 

growth  versus  cumulative  flight  hours 


The  reliability  growth  rates  in  Figure  5  are  also 
lower  than  the  Duane/RPM  0.5  value. 


(2) 


In  order  to  explain  the  difference  in  apparent  growth 
rates  between  the  UH-1D  and  the  AH-1G,  the  author 
hypothesized  that  a  calendar  time  constraint  exists 
on  the  rapidity  with  which  helicopter  reliability 
growth  can  occur.  No  matter  how  Quickly  flight  hours 
are  run  up,  there  is  a  practical  limit  to  how  quickly 
failure  modes  can  be  analyzed,  design  improvements 
made,  approved,  and  implemented.  While  the  intensity 
of  the  AH-1G  program  was  higher  than  the  UH-1D  pro¬ 
gram,  the  rate  of  failure  rate  improvement  when 
measured  against  calendar  time  was  approximately 
equal  for  both  programs  and  constant  throughout  the 
data  collection  period,  as  shown  in  Figure  6.  The 


author  assumed  that  the 


intensities  of  both  heiicopte 


PERCENTAGE  DECREASE  IN  FAILURE  RATE 


Delivery  FV  AIRCRAFT 

Figure  6.  BELL  STUDY  [34]  PERCENTAGE  DECREASE  IN  FAILURE 
RATE  VERSUS  FY  AH-1G  AND  UH-1D  AIRCRAFT 

M&R  programs  exceeded  the  calendar  time  to  flight- 
hour  threshold  (estimated  to  be  approximately  1,200 
flight  hours  per  month),  and  the  upper  bound  on 
growth  rate  versus  calendar  time — computed  from 
Figure  6  to  be  8.6  percent  per  year — was  reached 
in  both  programs. 

(3)  Aware  of  the  Rummel  study  [28],  Conway  devoted  a 
section  of  [34]  to  a  discussion  of  the  differences 
between  his  results  and  those  of  Rummel.  All  of  the 
failure  modes  detected  and  counted  during  the  M&R 
programs  had  associated  mean  times  between  failure 
in  the  notation  used  above)  of  5>000  hours 
or  less.  Thus  Rummel' s  approach  would  imply  that 
a  test  program  of  10,000  hours  (2  times  MTBF)  would 
be  sufficient  to  achieve  the  same  level  of  growth 
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as  the  50 , 000-hour  M&R  program.  Conway  lists  a 
number  of  reasonable  explanations  why  the  Rummel 
approach  is  overly  optimistic: 

•  Many  failure  modes  are  calendar-time-dependent  and 
may  not  arise  in  a  relatively  short  calendar  period 
test  program. 

•  Many  failure  modes  are  environment -dependent  and  will 
not  be  exposed  in  a  test  program  on  prototype  aihcraft. 

•  Corrective  actions  initiated  for  failure  modes  dis¬ 
covered  during  prototype  tests  may  not  be  incorporated 
until  the  production  aircraft.  Thus,  many  development 
tests  may  be  prematurely  terminated  by  failure  modes 
for  which  corrective  actions  already  exist. 

•  A  corrective  action  efficiency  of  seven  failures  to 
fix  is  more  reasonable  in  a  field  environment,  versus 
the  single  occurrence  assumed  by  Rummel  for  a  labora¬ 
tory  environment . 

(We  remark  that  the  last  reason  itself  may  be  suffi¬ 
cient  to  explain  the  fivefold  increase  in  estimated 
test  time.  Assuming  the  usual  exponential  distribu¬ 
tion  for  times  between  failure  occurrences,  it  can  be 
shown  from  tables  of  the  Poisson  distribution  that 

failure  mode  failure  mode 

occurs  at  least  ~  p  occurs  at  least 
once  in  time  period  7  times  in  time  period 

of  length  2  x  MIBF  of  length  10  x  MIBF 

(4)  Conway  made  several  qualitative  recommendations  for 
future  helicopter  programs  based  upon  his  study 
results,  including: 

•  In  view  of  the  observed  constraints  on  field  reli¬ 
ability  growth,  intensive  reliability  engineering 
effort  should  be  devoted  during  the  design  phase  to 
improving  the  off-the-board  failure  rate. 

•  A  reliability  program  of  field  failure  monitoring 
on  a  controlled  sample  of  production  helicopters 
should  be  included. 


=  0.87.  ) 


While  Conway  indicated  that  the  Rummel  approach  may  not 
be  valid  for  field  reliability  growth  efforts,  Conway's 
approach  may  require  additional  explanatory  variables  (perhaps 
additional  time  lags)  before  extrapolation  from  a  controlled 
sample  of  helicopters  to  a  fielded  fleet  is  valid.  In  IDA 
Study  S-451  [1],  published  UH-1D  fleet  reliability  data 
(Figure  9,  p.  34  of  that  study)  indicate  that  during  the  < 
period  July  1964  through  July  1965  (corresponding  to  flight 
hours  5,500  through  25,000  of  the  M&R  program)  the  fleet  reli¬ 
ability  was,  in  fact,  declining. 

4 .  Other  Related  Studies 

An  extensive  taxonomy  of  reliability  activities  compris¬ 
ing  helicopter  reliability  development  programs  is  presented 
in  reference  [35].  Using  the  Rummel  study  as  a  basis  for 
inferring  that  reliability  development  costs  can  be  related 
to  helicopter  reliability  achieved,  the  report  also  proposes 
(in  general  terms)  a  methodology  for  planning  helicopter  reli¬ 
ability  development  programs  to  minimize  development  plus  O&M 
costs  which  is  virtually  identical  to  the  FAA  approach  [24] 
summarized  above. 

Focusing  on  the  flight  testing  phase  of  a  hypothetical 
(though  patterned  on  the  Black  Hawk)  helicopter  development 
program.  Pollack  and  Nulk  [36]  propose  a  method  for  determin¬ 
ing  the  number  of  prototypes  to  be  fabricated  in  order  to  also 
minimize  the  reliability  contributions  to  development  plus  O&M 
costs.  Reliability  growth  during  development  is  assumed  to 
adhere  to  the  Duane  model;  the  "starting  point"  and  growth 
rate  are  taken  to  be  the  Selby  and  Miller  values — 10  percent 
of  final  cumulative  MTBF  and  0.5,  respectively.  (While  the 
actual  values  chosen  do  not  invalidate  the  approach,  both  the 
3eli  study  findings  discussed  above  and  the  additional  results 
presented  in  Chapter  II  below  suggest  that  those  values  are 
not  appropriate  for  helicopters.  The  starting  point  is  too 
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low,  and  the  growth  rate  too  high.)  Given  the  reliability 
goal,  the  growth  curve  yields  the  number  of  flight  hours 
required  during  development.  As  the  number  of  prototypes  is 
varied,  the  duration,  in  calendar  time,  of  the  development 
program  also  varies.  The  authors  assume  that  the  cost  of 
that  program  is  a  convex  function  of  the  number  of  prototypes, 
with  a  minimum  near  the  midpoint  of  the  range  of  possible, 
prototype  values.  The  O&M  cost  is  also  taken  to  be  a  convex 
(decreasing)  function  of  the  number  of  prototypes  in  that  a 
more  rapid  development  program  leads  to  more  rapid  replace¬ 
ment  of  the  existing  fleet  by  the  newly  developed  aircraft, 
which  are  assumed  to  be  less  expensive  to  operate  and  maintain. 
Adding  the  two  functions,  the  minimizing  number  of  prototypes 
can  be  determined. 

Finally,  a  paper  by  the  Logistics  Management  Institute 
[11]  proposes  a  methodology  for  setting  reliability  require¬ 
ments  which  is  clearly  applicable  to  helicopter  programs 
although  it  is  applied  primarily  to  fixed-wing  aircraft  in 
case  studies  described  in  the  paper.  The  objective  is  to 
determine  optimal  subsystem  reliability  goals  such  that  life 
cycle  costs  are  minimized.  In  particular,  the  cost  objective 
function  comprises  three  components:  (1)  the  Cost  of  Achiev¬ 
ing  Reliability,  including  design  costs,  prototype  costs, 
testing  costs,  and  costs  of  corrective  actions,  (2)  the  Cost 
of  Downtime,  which  is  the  cost  of  procuring  and  operating 
additional  systems  to  overcome  mission  reliability  and  opera¬ 
tional  availability  constraints  and  enable  performance  of  a 
given  mission,  and  (3)  the  (recoverable)  Cost  of  Maintenance, 
which  is  the  cost  of  all  the  unscheduled  maintenance  events. 

In  computing  values  for  the  above  cost  components,  the 
Duane  reliability  growth  model  is  assumed  to  hold  during 
development  at  the  system  level.  The  subsystem  development 
reliabilities  are  assumed  to  carry  over  to  field  use 
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(after  definitional  adjustments  have  been  made  for  equipment 
operating  versus  system  flight  hours),  and  given  the  "failure 
criticalities"  of  each  of  the  subsystems  with  respect  co  the 
mission  objective  for  the  total  system,  a  heuristic  iterative 
procedure  for  "optimizing"  the  allocation  of  the  total  system 
failure  rate  to  the  subsystems  is  proposed.  The  development 
reliabilities  achieved  translate  into  system  mission  reli7 
ability  and  operational  availability  and  thereby  influence 
the  size  of  the  total  buy,  also  a  decision  variable,  through 
the  downtime  cost  component. 

The  LMI  approach  has  a  number  of  obvious  shortcomings. 

For  example,  more  decision  variables  governing  the  reliability 
activities  during  development  could  be  included.  Only  a 
single  type  of  testing  (at  the  system  level)  is  considered, 
and  the  apportionment  of  system  reliability  to  the  various 
subsystem  does  not  consider  the  development  resource  costs 
of  achieving  alternate  subsystem  reliabilities,  consideration 
of  which  certainly  might  have  an  effect  on  the  final  appor¬ 
tionment  since  some  subsystems  are  considerably  less  expensive 
to  test  in  dollars  and  calendar  time  than  others.  Also,  the 
cost  of  downtime  does  not  include,  for  example,  attrition  due 
to  hostile  action,  cannabalization ,  or  alternative  tyoes  of 
missions,  all  of  which  may  be  important  in  determining  the 
size  of  the  total  system  buy.  Furthermore,  from  our  summary 
of  electronics  reliability  literature,  we  know  that  the  trans¬ 
lation  of  development  to  fie  .d  reliability  involves  more  than 
just  the  one  definitional  conversion  used  in  [11]. 

However,  the  overall  framework  proposed  in  the  paper  would 
appear  to  be  expandable  to  a  useful  quantitative  approach  to 
the  problem  posed  by  the  flowchart  in  Figure  1.  Apart  from 
purely  theoretical  treatments  such  as  the  one  appearing  in  [37], 
it  is  the  only  model  we  know  of  which  addresses  the  reliability 
apportionment  issue,  as  well  as  being  the  only  model  to  incor¬ 
porate  buy  size  as  a  decision  variable.  In  case  studies  of 
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various  aircraft  programs  to  which  the  modeling  approach  was 
applied,  the  authors  concluded  that  intensive  reliability 
improvement  programs  during  system  development  could  have 
resulted  in  significant  cost-effectiveness  benefits,  even 
with  buy  size  (fixed  at  the  actual  levels  of  procurement) 
deleted  from  the  set  of  decision  variables. 

E.  SUMMARY 

Our  survey  of  the  literature  indicates  that  the  relation¬ 
ship  between  resources  invested  in  reliability  and  reliability 
achieved  is  not  well  understood.  No  single  study  has  addressed 
all  of  the  issues  raised  in  Section  A  above.  The  studies  of 
electronics  equipment  reliability  growth  imply  that  sufficient 
understanding  of  the  processes  involved  in  improving  reliabil¬ 
ity  exists  for  useful  data  to  be  generated.  Thus  far,  however, 
analytical  attention  in  using  those  data  has  been  focused  on 
making  marginal  changes  to  existing  development  strategies. 

The  broader  objectives  of  setting  reliability  goals  and  of 
overall  program  planning  to  minimize  ownership  or  development 
plus  ownership  costs  have  only  been  addressed  in  the  abstract. 
Obstacles  yet  to  be  overcome  include  the  definition  of  a 
"standard"  taxonomy  of  reliability  improvement  activities,  the 
definition  of  what  constitutes  cost  of  reliability  improvements 
as  distinct  from  other  development  costs,  and  determination  of 
a  means  for  translating  measured  development  reliability  into 
measured  field  reliability. 

In  the  helicopter  area,  data  from  past  programs  have  been 
much  more  scarce,  particularly  on  the  subsystem  level  during 
development  testing,  a  level  on  which  it  would  appear  necessary 
to  work  in  order  to  develop  analytical  models  for  setting 
reliability  goals  or  planning  and  evaluating  (in  advance) 
development  programs.  Additional  problems  exist,  such  as 
reliability  apportionment,  which  have  yet  to  be  incorporated 
into  studies  of  historical  data.  The  parameter  of  interest  in 


tracking  reliability  improvement  in  published  studies  has 
usually  been  Mean  Time  Between  Removals.  The  relationship 
(if  any)  between  this  parameter  and  the  parameter  Mean  Time 
Between  Failures,  currently  used  as  a  yardstick  for  monitoring 
reliability  growth  in  helicopters  such  as  the  Black  Hawk  dis¬ 
cussed  in  Chapter  II  below,  needs  to  be  determined.  A  common 
thread  linking  the  analyses  performed  to  date  comparing  reli¬ 
ability  improvement  achieved  during  development  with  that 
achieved  in  the  field  is  the  concept  of  corrective  action 
efficiency — the  number  of  occurrences  of  a  failure  mode  which 
are  required  before  that  mode  is  recognized  as  a  candidate  for 
corrective  action. 

Reliability  growth  models,  particularly  the  Duane  model, 
are  used  throughout  the  literature  and  appear  to  fit  reliability 
data  reasonably  well.  For  monitoring  reliability  growth  trends 
of  electronics  programs  or  of  helicopter  programs  at  the  system 
level,  they  appear  to  be  useful.  For  planning  future  programs, 
given  more  detailed  cost  data  covering  additional  resource 
variables  besides  the  independent  variable  used  to  develop  a 
growth  model,  however,  other  functional  relationships  may  be 
more  appropriate,  as  was  found  to  be  the  case  in  the  studies  by 
3E  [21]  and  Hughes  [22]. 
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Chapter  II 


DEVELOPMENT  PHASE  R&M  DATA 

Section  I 

Black  Hawk  (UH-6QA)  Reliability,  Availability, 
and  Maintainability  Trends 


A.  INTRODUCTION 

This  section  presents  a  summary  of  reliability,  avail¬ 
ability  and  maintainability  (RAM)  trends  experienced  by  the 
Black  Hawk  program  throughout  the  development  phase  and  the 
first  two  years  of  the  production  phase.  The  information  has 
been  derived  from  published  sources  and  additional  Army  RAM/ 

LOG  (Reliability,  Availability,  Maintainability,  Logistics 
Sample  Data  Systems)  and  UMSDC  (Unscheduled  Maintenance  Special 
Data  Collection  System)  data  furnished  IDA  by  the  US  Army  Troop 
Support  and  Aviation  Materiel  Readiness  Command,  and  is  pri¬ 
marily  descriptive.  Lack  of  comparable  historical  data  pre¬ 
cludes  any  extensive  comparisons  with  past  development  programs. 
Those  inferences  which  can  be  drawn  from  comparisons  of  the 
identified  Black  Hawk  RAM  trends  with  those  of  past  helicopter 
programs  are  deferred  until  Section  VII  below. 

This  section  briefly  describes  the  chronology  of  the  31ack 
Hawk  program  and  the  definition  of  the  RAM  parameters  of  inter¬ 
est  and  the  associated  program  goals;  it  then  presents  the  data 
and  subsequent  analyses;  finally  there  is  a  summary  of  findings. 


BACKGROUND 


B  . 

1 .  Black  Hawk  Program  History 

Originally  known  as  the  Utility  Tactical  Transport  Air¬ 
craft  System  (UTTAS),  the  Black  Hawk  was  developed  as  a 
replacement  for  the  UH-1  series  helicopters  for  air  assault, 
air  cavalry,  and  medical  evacuation  missions.  Approval  for 
full-scale  development  occurred  in  June  1971;  in  July  1971 
a  request  fcr  quotation  (HPQ)  for  development  of  an  advanced 
technology  turbo shaft  engine  was  released  to  industry.  In 
January  1972  a  Request  for  Proposal  (RFP)  was  issued  to 
industry  for  the  airframe  development.  General  Electric 
was  awarded  the  engine  development  contract  in  March  1972 
and  in  August  1972  Boeing  Vertol  and  Sikorsky  were  awarded 
competitive  airframe  development  contracts. 

Each  airframe  contractor  constructed  three  flying  proto¬ 
types  (reduced  by  Congress  from  six  each  called  for  in  initial 
Army  plans),  one  ground  test  vehicle  (GTV)  and  one  static  test 
article  (STA).  Each  company  also  built  a  fourth  flight  article 
with  company  funds.  Prototype  qualification  testing  commenced 
in  October  1979  and  was  completed  in  December  1976.  Approxi¬ 
mately  2,910  flight  test  and  2,750  ground  vehicle  test  hours 
were  accumulated  by  the  two  contractors  during  that  period. 
Government  Competitive  Testing  (GCT)  ( DT  II/CT  II)  began  In 
March  1976  and  continued  through  September  1976.  Approxi¬ 
mately  551  flight  hours  on  two  prototypes  from  each  contractor 
were  logged  during  the  latter  period.  DSARC  III  was  held  in 
November  19~6.  Selection  of  Sikorsky  as  the  airframe  con¬ 
tractor  was  announced  along  with  the  initial  production 
contract  award  in  December  1976. 


Between  February  1977  and  February  1979,  the 
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1978,  one  of  the  three  prototypes  crashed,  leaving  two 
prototypes  to  complete  that  phase  of  the  program. 

Production  aircraft  deliveries  began  in  October  1978. 
Between  June  and  October  of  1979,  initial  operational  testing 
(the  Force  Development  Test  and  Experimentation  (FDTE)  pro¬ 
gram)  was  conducted  utilizing  eight  first-year  production 

4 

aircraft  in  an  aviation  company  at  Fort  Campbell.  The  FDTE 
program  was  designed  to  (a)  evaluate  flight  characteristics 
and  measure  performance  capabilities,  (b)  assess  operational 
reliability,  availability  and  maintainability  of  the  Black 
Hawk,  and  (c)  address  additional  logistics  issues.  Figure  7 
summarizes  the  program  schedule. 
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Figure  7.  BLACK  HAWK  PROGRAM  SCHEDULE 


2 .  RAM  Definitions,  Goals  and  Measurement  Procedures 

Black  Hawk  program  goals  were  established  for  several  RAM 
measures,  as  follows: 

(1)  System  Reliability.  The  parameter  receiving  greatest 
management  attention  throughout  the  development  phase  of  the 
program  appears  to  have  been  System  Mean  Time  Between  Failures 
(MTBF).  System  MTBF  is  defined  in  terms  of  chargeable  (to  the 
contractor),  independent  failures.  A  comprehensive  data  collec¬ 
tion  system  and  detailed  scoring  criteria  were  established  prior 
to  GCT  in  order  to  accurately  measure  this  and  other  RAM  char¬ 
acteristics.  In  order  to  compute  System  MTBF,  time  is  defined 
as  flight  hours  measured  from  lift-off  until  touchdown.  An 
item  is  considered  to  have  failed  any  time  corrective  mainte¬ 
nance  manhours  must  be  expended  on  the  item  regardless  of  when 
the  failure  occurs  or  is  discovered  prior  to  lift-off,  during 
flight  or  after  touchdown.  The  Black  Hawk  goal  is  a  System 
MTBF  of  4.0  (or,  alternatively,  a  system  failure  rate1  of  0.25). 
During  the  FDTE  program  and  in  data  collection  on  subsequent 
production  aircraft,  the  system  failure  definition  was  expanded 
to  include  false  malfunction  indications  resulting  in  mission 
aborts.  At  the  same  time,  "Operational  Failures"  were  defined 
to  include  all  system  failures  plus  dependent  failures,  operator 
and  maintenance  errors,  foreign  object  damage,  and  GSE-induced 
malfunctions.  No  contractual  goal  has  been  established  for  the 
latter  parameter,  although  2.7  flight  hours  is  cited  (Reference 
[38]  as  the  minimum  acceptable  value  on  the  basis  that  at  that 
value  the  maintenance  burden  for  the  UH-60A  will  equal  the 
maintenance  burden  for  the  current  utility  helicopter. 

(2)  Mission  Reliability.  Mission  reliability  is  defined 
as  the  probability  of  completing  a  one-hour  mission  without  a 
malfunction  which  results  in  a  mission  abort.  Flying  time  is 


'in  the  analyses  below,  we  use  System  Failure  Rate,  rather  than  its  recip¬ 
rocal  System  MTBF,  to  present  the  31ack  Hawk  data. 
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one  hour,  but  the  mission  includes  events  from  the  start  of  the 
flight  crew's  preflight  inspection  through  engine  shutdown 
following  completion  of  the  last  mission  leg.  In  addition  to 
unintended  landings  or  discontinuance  of  the  mission,  failures/ 
malfunctions  detected  during  preflight  inspection  that  require 
more  than  30  minutes  of  clock  time  to  correct,  or  total  accumu¬ 
lated  delays  of  more  than  30  minutes  experienced  during  the 
course  of  the  mission  as  a  result  of  failures/malfunctions  are 
chargeable  as  mission  aborts.  The  mission  reliability  goal  for 
the  Black  Hawk  is  .987.  1  In  order  that  a  Combat  Support  Avia¬ 
tion  company  be  able  to  lift  the  assault  elements  of  one  rifle 
company,  a  minimum  acceptable  value  of  .982  has  been  established 
[38]  . 

(3)  Flight  Safety  Reliability.  This  is  defined  as  the 
probability  of  completing  a  one-hour  mission  without  failure 
or  malfunction  which  results  in  a  forced  landing  or  mishap.  A 
mishap  is  defined  as  an  equipment  malfunction/ failure  which  is 
potentially  injurious  to  or  results  in  injury  to  flight  crew, 
ground  crew  or  passengers,  or  damage  to  the  aircraft.  The 
flight  safety  reliability  goal  is  0.9997.  The  evaluation  of 
this  parameter  will  not  occur  until  165,000  flight  hours  have 
been  logged. 

(4)  Operational  Availability.  This  is  the  probability 
that  a  randomly  requested  aircraft  is  not  down  for  maintenance 
or  spare  parts.  Maintenance  downtime  is  the  sum  of  all  clock 

^  the  analyses  below,  mission  reliability  data  are  presented  using  the 
Mission  Abort  Rate.  Mission  Reliability  is  determined  by 

Mission  Reliability  =  1  -  e-(Abort  *><*). (Mission  Time)  _ 

For  one-hour  mission  with  mission  reliability  close  to  1,  we  have 
Abort  Rate  si-  (Mission  Reliability)  . 

Thus,  the  mission  reliability  goal  expressed  in  terms  of  Abort  Rate  is  0.01 
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time  for  preventive  and  corrective  ( on-aircraft )  maintenance. 
The  Operational  Availability  goal  is  0.82,  based  on  a  utiliza¬ 
tion  rate  of  69  flight  hours  per  month.  A  minimum  acceptable 
value  of  0.80  corresponds  to  the  0.982  mission  reliability  for 
the  assault  mission  discussed  above.  In  order  to  assess  this 
parameter,  "Achieved  Availability"  is  first  computed.  Divid¬ 
ing  maintenance  downtime  by  flight  hours  actually  flown  yields 
the  factor  hours  downtime  per  flight  hour.  Multiplying  this 
value  by  69  yields  a  downtime  total  for  a  69  flight  hour  month. 
Achieved  Availability  is  computed  using  this  total.  Subtract¬ 
ing  0.10  (assuming  an  8  percent  Not  Operationally  Ready  Supply 
(NORS)  rate  and  a  2  percent  administrative  delay  rate)  from 
Achieved  Availability  yields  Operational  Availability. 

(5)  Corrective  Maintenance  Manhours  per  Flight  Hour.' 
Actions  at  the  aviation  unit  (AVUM)  and  intermediate  unit 
(AVIM)  levels  comprise  the  maintenance  manhour  component  of 
this  parameter.  Modification  work  orders  and  configuration 
changes,  cannibalization,  and  unwarranted  actions  are  excluded. 
In  addition,  avionics  and  weapons  system  actions  are  excluded. 
The  program  goal  is  2.8  manhours  per  flight  hour.  For  assess¬ 
ment  after  October  1979  to  determine  if  maintainability 
Improvements  are  required,  the  Black  Hawk  project  manager's 
office  has  accepted  3.8  manhours  per  flight  hour,  including 
preventive  as  well  as  total  corrective  maintenance,  as  the 
goal. 

Finally,  various  Mean  Time  Between  Removals  (MTBR) 
goals  have  been  contractually  established  for  the  dynamic 
components  of  the  Black  Hawk.  These  are  to  be  demonstrated 
after  25,000  flight  hours  of  data  have  been  collected. 
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C.  DATA  AND  ANALYSES 
1 .  Army  Data  Systems 

Several  Army  data  systems  provide  data  for  monitoring 
RAM  characteristics  of  the  Black  Hawk  aircraft.  The  most 
comprehensive  of  these  is  the  RAM/LOG  system.  Under  RAM/LOG, 
detailed  data  on  most  aspects  of  reliability,  availability 
and  maintainability  are  recorded  by  specially  trained,  dedi¬ 
cated  data  collectors.  An  extensive  computer  software  system 
has  been  created  to  process,  edit,  and  provide  access  to  data 
so  collected. 

The  primary  purpose  of  the  RAM/LOG  system  is  to  deter¬ 
mine  compliance  with  program  milestones  and  contractual 
requirements.  During  the  Black  Hawk  program,  data  were 
collected  throughout  the  development  phase  of  all  three 
prototypes,  and  then  on  early  flight  hours  or  selected  air¬ 
craft  from  each  of  the  first  two  production  years.  In  the 
case  of  the  second  year  production  aircraft,  the  intensity 
(and  cost)  of  the  data  collection  effort  was  reduced  by  elimi¬ 
nating  the  monitoring  of  the  detailed  maintenance  subtasks 
and  thereby  reducing  the  number  of  dedicated  data  collectors. 
"Modified  RAM/LOG"  is  the  phrase  used  to  refer  to  the  latter 
data.  Table  9  summarizes  the  RAM/LOG  data  collected  as  of 
March  1980. 

The  RAM/LOG  data  system  does  not  provide  cross-sectional 
fleet  data  on  fielded  systems;  this  information  is  beginning 
to  be  provided  by  the  Unscheduled  Maintenance  Sample  Data 
Collection  (UMSDC)  System.  Tested  in  late  1978  and  imple¬ 
mented  early  in  1979,  this  system  is  intended  to  supply  less 
extensive  but  far  more  reliable  data  than  were  collected  under 
the  old  TAMMS  system.  A  subset  of  the  aviation  field  units  is 
selected  for  data  collection.  At  each  selected  unit,  UMSDC 
forms  (modified  TAMMS  2^07  forms)  are  completed  by  that  unit's 
mechanics,  and  reviewed  for  accuracy  and  consistency  by  a 
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Table  9.  BLACK  HAWK  PROGRAM  RAM/LOG  DATA  COLLECTED 
AS  OF  MARCH  1980 


Jun.  76  -  Sept.  76 

Complete  RAM/LOG  data  during  competitive  flyoff  at  Ft.  Campbell. 

Tail  numbers  S50,  S52  for  the  Sikorsky  UH-60A;  V56,  V57  for  the 

Boeing  Vertol  TUH-61A. 

Sept.  76  -  Feb.  77 

No  flight  hours  logged. 

Feb.  77  -  Feb.  79 

Maturity  Phase.  Total  RAM/LOG  data  on  the  three  UH-60A  prototypes  - 
S50,  S51 ,  S52 — plus  early  flight  hours  logged  on  all  production 
aircraft  at  Stratford,  CT. 

May  78 

Total  loss  of  S50. 

Nov.  78  -  Mar.  80 

Complete  RAM/LOG  on  RAM  Durability  (RAM-0)  aircraft  (one  UH-60A) 
at  Ft.  Rucker. 

Jun.  79  -  Oct.  79 

FOTE  Program,  Ft.  Campbell.  Complete  RAM/LOG  data  (using  new 
data  collection  formulas)  on  eight  aircraft  (some  with  few  flight 
hours  as  a  consequence  of  entering  FDTE  near  the  end  of  the 
program) . 

Nov.  79  -  Mar.  80 

Complete  modified  RAM/LOG  data  collected  at  Ft.  Campbell  on  a 
unit  of  fifteen  production  aircraft  (different  from  the  FDTE 
aircraft  above). 

dedicated  UMSDC  on-site  field  monitor  before  being  submitted 
to  the  UMSDC  data  base.  As  of  June  1980  approximately  4300 
31ack  Hawk  flight  hours  had  been  so  collected. 

Two  oth^r  Army  data  systems  should  be  noted  in  connection 
with  the  Blacr.  Hawk  program.  The  Component  Report  for  Inten¬ 
sive  Management  (CRIM)  system  tracks  the  dynamic  components 
of  the  Black  Hawk  in  support  of  the  reliability  warranties  in 
effect.  Mean  Time  Between  Removals  data,  provided  by  CRIM, 
are  not  readily  extracted  from  either  the  RAM/LOG  or  UMSDC 
data  systems,  nor  are  they  complete  since  those  systems  only 
monitor  selected  aircraft.  Finally,  the  Operational  Readiness 
(1352)  Reporting  system  provides  data  on  operational  avail¬ 
ability  of  fielded  aircraft. 
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2 .  Data  Analysis  Methodology  and  Limitations 

a .  Data  Furnished  IDA 

The  Black  Hawk  data  (Reference  [39])  analyzed  below  come 
primarily  from  the  RAM/LOG  data  base.  Additional  UMSDC  data 
also  were  furnished  IDA,  but  the  latter  do  not  appear  compat¬ 
ible  with  RAM/LOG  data  for  analytical  purposes.  A  discussion 
of  the  apparent  differences  in  the  two  data  bases  as  well  as 
an  analysis  of  the  UMSDC  data  is  deferred  until  Section  C.3»e 
below. 

The  RAM/LOG  data  have  been  aggregated  into  contiguous 
90-day  time  intervals.  The  aircraft  on  which  data  were 
collected  and  the  number  of  flight  hours  flown  are  listed 
in  Table  10.  Figure  8  relates  this  RAM/LOG  data  sample  to 
the  total  program  flight  hours.  During  development,  the 
RAM/LOG  data  are  essentially  total,  although  the  approximately 
600  flight  hours  logged  on  the  prototypes  before  the  Army  took 
possession  are  not  included  in  either  curve  shown  in  the 
Figure. 

In  some  Instances,  minor  contradictions  were  observed 
between  the  IDA  data  and  published  sources  (References  [38], 
[40] ,  [41],  and  [42]).  For  example,  larger  numbers  of  system 

failures  for  the  FDTE  aircraft  appeared  in  the  computer  list¬ 
ings  provided  IDA  than  were  cited  in  Reference  [38] .  In 
another  case.  Reference  [42]  indicated  that  no  flight  hours 
were  logged  on  a  prototype  for  which  the  computer  listing 
showed  45  flight  hours  and  40  system  failures.  (In  the  former 
example,  the  discrepancy,  as  explained  in  conversations  with 
TSARC0M  personnel,  was  caused  by  deferred  maintenance  items 
discovered  in  a  post-FDTE  inspection  of  the  aircraft  involved 
and  entered  into  the  RAM/LOG  data  base  after  [38]  was  gener¬ 
ated;  in  the  latter  example,  the  discrepancy  was  never 
explained,  but  the  total  flight  hours  and  system  failure 
counts  derived  from  either  Reference  [39]  or  Reference  [42] 
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Table  10.  BLACK  HAWK  RAM/LOG  DATA  FURNISHED  IDA 


— 

Aircraft 

— 

Cumulati  ve 

Time 

Flown 

Flight 

FI  igrtt 

Proqram 

Period 

(Tail  Nos.) 

Hours 

Hours 

Prototypes 

SI  56- 5245 

S50,  S52 

2.6 

2.6 

5246-5335 

S50,  S51 .  S52 

98.0 

100.6 

i 

5336-6060 

0.0 

100.6 

6061-6150 

S50,  S52 

282.6 

383.2 

6151-6240 

S50,  S52 

273.0 

656.2 

6241-6330 

S50,  S52 

3.7 

659.9 

6331-7054 

- 

0.0 

659.9  1 

7055-7144 

S50,  S51 ,  S52 

155.9 

815.8  j 

7145-7234 

S51 ,  S52 

.67.9 

882.7  ! 

7235-7324 

S50,  $51 ,  S52 

148.4 

1032.1 

7325-8049 

S50,  SSI,  S52 

136.6 

1168.7  | 

8050-8139 

S50,  S52 

75.6 

1244.3 

j 

3140-8229 

SSI 

3.2 

1247.5 

3230-8319 

$51 ,  $52 

184.7 

1432.2 

1 

8320-9044 

S51 ,  $52 

86.1 

1518.3 

9Q45-9134 

S51 

3.0 

1521.3 

FDTE  (First  Year 

9134-9223 

$21 ,  S22,  $23, 

Production) 

$60 

154.4 

154.4 

9224-9313 

S21-S25, 

S27 ,  S28,  S60 

585.6 

740.0 

RAM-D  (First  Year 

8318-9043 

SI  5 

12.6 

12.6 

Production) 

i 

9044-9133 

SI  5 

82.2 

94.8 

9134-9223 

SI  5 

124.4 

219.2 

9224-9313 

SI  5 

319.6 

Test  (First  Year 

Production)  Aircraft  at 

8318-9043 

34.5 

34.5  ; 

Contractor  Site 

9044-9133 

85.8 

120.3  | 

-  | 

Second  Year  Production 

9314-0033 

S73-S75, 

Aircraft 

S77-S85 

372.1 

372.1 

0039-0128 

S73-S75 

S77-S85 

S88,  S89,  S92 

987.6 

1359.7 
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Figure  8.  RAM/LOG  AND  TOTAL  BLACK  HAWK  SYSTEM  FLIGHT 
HOURS  AS  OF  MARCH  1980 


are  very  close. )  In  the  analyses  presented  below,  the  computer 
listings  are  used  as  the  data  source  in  all  cases.  Published 
sources  were  checked  for  consistency,  and  no  major  discrep¬ 
ancies  were  discovered. 

b .  Methodology  and  Limitations 

In  aggregating  and  displaying  the  RAM/LOG  data  below,  a 
number  of  implicit  assumptions  were  made  which  require  explana¬ 
tion. 
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First,  in  plotting  the  data  chronologically,  the  three 
sources  of  first-year  production  aircraft  data  are  aggregated. 
While  different  test  environments ,  mission  profiles,  utiliza¬ 
tion  rates,  etc.,  characterize  each  of  these  sources,  the 
resulting  curves  have  the  effect  of  smoothing  the  differences 
in  RAM  parameter  values  exhibited  by  the  groups  of  aircraft 
at  the  three  sites.  In  some  cases,  therefore,  additional  dis¬ 
plays  highlighting  those  differences  are  presented.  However, 
in  any  reliability  growth  study,  different  articles  simulta¬ 
neously  undergo  different  test  environments.  The  justifica¬ 
tion  for  plotting  the  reliability  with  time  (test  hours,  flight 
hours)  as  the  sole  independent  variable  lies  in  the  fact  that 
failure  mode  information  from  the  various  tests  has  been  com¬ 
bined.  3y  aggregating  reliability  data,  we  are  making  the 
same  implicit  assumption — that  failure  mode  and  corrective 
action  information  are  communicated  from  site  to  site;  in  other 
words,  that  the  aggregated  reliability  curve  somehow  represents 
the  actual  status  of  the  total  program  at  each  point  in  time. 

Second,  in  conforming  to  standard  reliability  growth 
literature,  data  are  plotted  in  terms  of  cumulative  rates. 
Ideally,  in  monitoring  a  development  or  production  program, 
one  would  like  to  know  the  Instantaneous  rate  for  each  RAM 
parameter  at  each  point  in  time.  However,  while  the  cumula¬ 
tive  rate  Is  available  directly  from  the  data,  the  instanta¬ 
neous  rate  is  not.  The  instantaneous  rates  are  readily  derived 
whenever  the  cumulative  rates  plotted  vs  time  are  linear  on 
rectangular,  semi-log,  or  log-log  (the  "Duane"  curve)  grids.1 
In  other  cases,  one  must  fit  a  curve  to  the  cumulative  number 
of  failures  vs  time  plot  and  differentiate  it  to  obtain  the 


lLet  c(t)  =  cumulative  failure  rate 

n(t)  =  cumulative  ■'umber  of  failures 
i(t)  =  instantaiu-  us  failure  rate. 


Then 


in(t) 

it 


(continued  on  next  page) 


instantaneous  rate  curve  (see,  for  example,  reference  [17]). 
Using  the  apparent  linearity  of  both  cumulative  system  failure 
rate  and  cumulative  mission  failure  rate  plots  during  various 
phases  of  the  31ack  Hawk  program,  we  have  tentatively  also 
obtained  instantaneous  rate  curves  for  those  parameters.  The 
derivations  are  discussed  in  some  detail  in  Section  C.3 .a. 

AMS A A  (Reference  [A3])  has  taken  a  slightly  different  approach 
to  reliability  growth  tracking  of  the  UH-60A.  They  develop 
failure  rate  point  estimates  based  on  small,  approximately 
equal,  flight-hour  intervals  and  display  those  rates  directly. 
Our  results  are  also  compared  to  theirs  in  Section  C.3. a  below. 

Finally,  in  extending  the  RAM/LOG  data  to  the  total  Black 
Hawk  fleet,  we  assume  that  the  production  aircraft  data  are 
representative  of  the  entire  fleet  and  we  linearly  extrapolate 
from  the  sample  data  to  obtain  failure  rates  for  the  fleet. 

This  procedure  is  illustrated  in  the  next  section,  but  it  is 
important  to  note  that  this  may  be  a  serious  shortcoming  of 
the  analysis.  If  the  failure  process  were  truly  exponential, 
a  valid  statistical  argument  could  be  made  for  the  foregoing 
procedure.  However,  since  different  configurations  of  each 
production-year  aircraft  are  usually  fielded  at  the  same  time 
(retrofitting  changes  takes  time),  and  there  is  some  evidence 
that  many  helicopter  components  have  increasing  failure  rates 
over  time  (see,  for  example,  [33]),  it  is  likely  that  the  above 
procedure,  based  on  low  flight-hour  aircraft,  biases  the 
results  by  indicating  faster  fleet  reliability  growth  than  is 
actually  achieved.  Analysis  of  UMSDC  cross-sectional  fleet 
lata  in  Section  C.3.e  below  indicates  that  second-year  aircraft 


(contd)  and,  letting  A  =  "initial"  failure  rate  and  a  =  "growth  rate," 
we  have 
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log-linear 

log-log 


c(t) 

X— oit 

X-at • log  t 

—a 
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i(t) 


\-2at 

X— a ( log  t  +  log  e) 
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do,  in  fact,  appear  to  be  more  reliable  than  first-year  air¬ 
craft,  so  that  the  fleet  as  a  whole  has  lower  average  reli¬ 
ability  than  the  second-year  aircraft  alone.  Cn  the  other 
hand,  if  one  is  interested  in  progress  related  to  successive 
years  of  new  production  aircraft,  such  growth  is  accurately 
(subject  to  sampling  errors)  measured. 

3 .  Resul ts 

a .  System  Reliability 

The  changes  in  31ack  Hawk  system  failure  rate  over  time 
are  shown  in  Figure  9-  Referring  to  the  Figure,  the  program 
appears  to  have  experienced  a  moderate  rate  of  reliability 
growth  through  Government  Competitive  Testing.  3y  the  end  of 
GCT,  the  system  failure  rate  was  approximately  .33  failures 
per  flight  hour  (MT3F  =  3  hours).  During  the  maturity  phase, 
the  failure  rate  appears  to  have  remained  more  or  less  constant 
at  1  per  hour.  Finally,  very  rapid  reliability  growth  is 
apparent  throughout  the  first  two  model  years  of  production 
aircraft.  Approximately  10  months  and  3,500  flight  hours  into 
the  production  phase,  the  program  returned  to  the  system  fail¬ 
ure  rate  level  measured  during  GCT.  As  of  March  1980,  the  pro¬ 
gram  appears  to  have  equaled  or  exceeded  the  0.25  failures  per 
flight  hour  goal.  The  remainder  of  this  subsection  is  devoted 
to  a  more  detailed  explanation  and  derivation  of  Figure  9. 

Figure  10  presents  a  cumulative  failure  rate  plot  of  the 
raw  RAM/LOG  data  plotted  against  the  total  system  flight  hours. 
Table  11  contains  the  data  comprising  the  Figure.  Note  in 
Table  11  that  the  RAM/LOG  system  failure  count  was  linearly 
extrapolated  during  the  post-production  phase  to  yield  a  fail¬ 
ure  count  for  the  fleet.  Also  note  that  while  Figure  10 
appears  to  show  a  worsening  failure  rate  during  the  maturity 
phase  (approximately  650  to  1,550  flight  hours).  Figure  9 
indicates  that  the  instantaneous  rate  actually  jumped  to  a 
higher,  but  relatively  constant,  level. 
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Table  11.  SLACK  HAWK  CUMULATIVE  FAILURE  RATES,  TOTAL  SYSTEM 


FI  i  ant 

Hours 

_ 

- 5 

stem  Failures 

RAM/ LOG 

Total  Fleet 

RAM/ LOG 

Total  Fleet 

Time  Period 

No. 

Cum. 

No. 

Cum. 

No. 

Cum. 

No. 

Cum. 

Cum. 

Rate 

Gun  75  -  Aug  75 

2.6 

3 

2.6 

3 

5 

5 

5.0 

5.0 

1.92 

Sep  75  -  Nov  75 

98.0 

101 

98.0 

101 

42 

47 

42.0 

47.0 

.47 

Dec  75  -  Fee  76 

0.0 

101 

0.0 

101 

0 

47 

0.0 

47.0 

.43 

Mar  76  -  May  76 

282.6 

383 

282.6 

383 

103 

150 

103.0 

150.0 

.39 

Dun  76  -  Aug  76 

273.0 

656 

273.0 

556 

88 

238 

88.0 

238.0 

.36  ! 

Sep  76  *  Nov  76 

3.7 

660 

3.7 

660 

1 

239 

1.0 

239.0 

.36 

Dec  76  -  fee  77 

0.0 

660 

0.0 

660 

0 

239 

0.0 

239.0 

.36  | 

Mar  77  -  May  77 

155.9 

816 

155.9 

816 

56 

295 

56.0 

295.0 

.36 

Jun  77  -  Aug  77 

67.9 

884 

67.9 

884 

50 

345 

50.0 

345.0 

.39 

Sep  77  *  Nov  77 

148.4 

1032 

148.4 

1032 

129 

474 

129.0 

474.0 

.46 

Dec  77  -  Feo  78 

136.6 

1169 

136.6 

1169 

92 

566 

92.0 

566.0 

.48 

Mar  73  -  May  73 

75.6 

1244 

75.6 

1244 

105 

671 

105.0 

671.0 

.54 

Dun  73  -  Aug  78 

3.2 

1248 

3.2 

1248 

101 

772 

101.0 

772.0 

.62 

Seo  78  -  Nov  78 

184.7 

1432 

184.7 

1432 

165 

937 

165.0 

937.0 

.65 

Dec  78  -  Feb  79 

133.2 

1565 

133.2 

1565 

113 

1050 

113.0 

1050.0 

,67  j 

Mar  79  -  May  79 

171 .0 

1736 

376.0 

1941 

119 

1169 

263.0* 

1313.0 

.63  ! 

Jun  79  -  Aug  79 

278.3 

2015 

828.0 

2769 

131 

1300 

389.  1* 

1702.0 

•«<  ! 

Sep  79  -  Nov  79 

586.0 

2701 

1909.0 

4678 

289 

1589 

804.2* 

2506.3 

.54 

Dec  79  -  Feb  80 

372.1 

3073 

2611.0 

7289 

106 

1695 

743.8* 

3250.1 

.45  ; 

Mar  80 

987.6 

4061 

1302.0 

8591 

189 

1884 

249.2* 

3499.2 

.41 

•Extrapolated  from  RAM/LOG  data. 


( 1 )  Basic  Engineering  Development  (BED)  Phase 

The  first  segment  of  the  instantaneous  system  failure  rate 
curve  in  Figure  9  was  obtained  by  first  fitting  a  line1  to  the 
BED  cumulative  failure  rate  values  (deleting  the  2.6  flight-hour 
point)  and  then  using  the  slope  (growth  rate)  of  that  line  to 


lHere  and  for  the  production  phase  data  to  follow,  least-square  regressions 
were  used  to  fit  lines  to  the  data.  Under  the  assumption  that  the  failure 
counting  process  giving  rise  to  the  data  is  a  Non-Homogeneous  Poisson  Process 
(NHPP),  maximum  likelihood  estimators  for  the  slopes  and  intercepts  of  such 
lines  have  been  derived  which  differ  slightly  frctn  those  yielded  by  least- 
square  regressions  (see,  e.g. ,  [14]).  However,  the  corrective  action  time 
lags  and  block  changes  which  characterize  helicopter  programs  tend  to  invali¬ 
date  (see,  e.g.,  [34])  the  continuous-growth  or  immediate-improvement¬ 
following-failure  assumptions  underlying  the  HHPP  approach. 
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generate  the  instantaneous  rate  curve  as  discussed  above.  The 
.'tmruted  growth  rate  is  0.13.  This  is  not  rapid  growth  accord¬ 
ing  to  ?.i>!  folklore  when  compared  to  the  "Duane"  standard  for 
a  "high  intensity"  development  program  of  0.5.  Also,  while  the 
:ontractors  did  incorporate  improvements  during  testing,  other 
reasons  have  been  put  forth  which  may  further  reduce  the  appar¬ 
ent  growth  rate.  In  particular,  [44]  states  that  during  test¬ 
ing  the  failure  criteria  were  changed,  with  certain  maintenance 
actions  being  reclassified  as  preventive  maintenance  and  there¬ 
fore  not  chargeable.  And  in  discussions  [43]  with  AMSAA 
personnel,  it  was  indicated  that  the  test  environment  during 
OT  II,  the  second  phase  of  GOT,  may  have  been  less  severe,  with 
more  nap-of-the-earth,  low-speed  (lower  vibration)  missions, 
than  during  DT  II,  the  first  phase  of  GOT.  Furthermore, 
neglecting  approximately  the  first  110  flight  hours  of  RAM/LOG 
data  which  occurred  prior  to  GOT,  very  little  growth  is  appar¬ 
ent  during  GOT  itself  as  is  evident  in  Figure  11,  taken  from 
Reference  [41] . 

On  the  other  hand,  the  "of f-the-board"  system  MTBF  was 
quite  high  (compared  to  the  "10  percent  of  final  MTBF"  rule 
of  thumb),  and  the  short  duration  of  the  competition  may  have 
been  a  limiting  factor  in  Initiating  corrective  action  for 
observed  failures.  Also  we  should  reiterate  that  the  data 
given  In  Table  11  and  plotted  in  Figure  10  do  not  Include  the 
approximately  600  initial  contractor  flight  hours.  If  the 
plotted  data  were  shifted  by  600  flight  hours  (that  is,  if  the 
instantaneous  failure  rates  shown  in  Figure  9  were  translated 
by  600  flight  hours  on  the  horizontal  axis),  the  computed 
growth  rate  would  Increase  somewhat.  It  is  interesting  to 
note,  however,  that  extrapolation  of  the  0.13  growth  rate 
over  the  entire  program  to  date  yields  a  system  reliability 
value  very  close  to  that  currently  measured  for  production 
aircraft  (see  Figure  9). 


FLIGHT  TIME 


Source:  Reference  [41] 

Figure  11.  CUMULATIVE  FAILURES  VERSUS  FLIGHT 
TIME  FOR  BLACK  HAWK  DURING  GCT 

( 2 )  Maturity  Phase 

During  the  maturity  phase,  a  large  number  of  components 
underwent  design  changes,  both  to  reduce  weight  because  there 
was  a  large  weight-reduction  incentive  award  and  to  enhance 
producib ility .  A  number  of  failures  were  the  result  of  minor 
parts  wearing  out  due  to  removals  and  modifications  of  such 
components.  For  example,  a  large  number  of  failures  of  the 
hydraulic  quick  disconnects  were  prematurely  induced  by  cou¬ 
pling  and  uncoupling  them  as  modifications  were  made  to  the 
hydraulic  flight  control  system.  Overstress  testing  induced 
further  failures,  such  as  many  broken  lights  during  testing 
with  the  vibration  absorbers  removed. 


The  system  failure  rate  jumped  significantly  between  GCT 
and  this  program  phase.  The  constant  failure  rate  shown  in 
Figure  9  is  derived  from  Figure  12.  Referring  to  the  latter 
Figure,  failures  appear  to  have  occurred  approximately  linearly 
with  flight  hours.  The  big  jump  at  approximately  1,240  flight 
hours  (101  failures  in  3-2  flight  hours)  was  a  result  of  a 
thorough  Inspection  immediately  following  the  crash  of  proto¬ 
type  S50.  Many  of  the  failures  uncovered  should  be  credited 
to  earlier  flight  hours.  For  that  reason  the  failure  rate 
appears  to  be  approximately  constant,  even  though  a  Chi-square 
or  other  goodness-of-fit  test  of  the  raw  data  in  Table  11 
would  not  support  that  hypothesis.  At  the  very  end  of  the 
maturity  phase,  the  reliability  may  have  improved  as  noted 
by  the  dotted  line  in  Figure  12.  On  the  whole,  however,  any 
improvements  resulting  from  corrective  action  seem  to  have 
been  counterbalanced  by  failures  resulting  from  further  design 
changes  or  Induced  by  the  test  environment.  AMSAA  personnel 
indicated  that  most  fixes  were  deferred  until  production  rather 
than  being  incorporated  into  the  prototypes. 

( 3 )  Production  Phase 

Aggregated  cumulative  failure  data  for  production  air¬ 
craft  only  versus  production  fleet  flight  hours  are  plotted 
in  Figure  13.  As  in  Figure  10,  failure  counts  for  the  total 
fleet  are  linearly  extrapolated  from  the  RAM/LOG  data.  Table 
12  summarizes  the  data  and  computations. 

For  the  production  aircraft,  operational  as  well  as  system 
failures  are  monitored.  The  ratio  of  operational  to  system 
failures  (approximately  1.3  operational  failures  per  system 
failure)  provides  some  indication  of  the  relationship  between 
reliability  in  the  field  and  reliability  as  measured  during 
development . 
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Figure  12.  CUMULATIVE  FAILURES  VERSUS  FLIGHT  HOURS  DURING 
THE  MATURITY  PHASE  OF  THE  BLACK  HAWK  PROGRAM 


Figure  13.  CUMULATIVE  FAILURE  RATES  VERSUS  FLIGHT 
HOURS  FOR  PRODUCTION  BLACK  HAWK 
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Table  12.  BLACK  HAWK  CUMULATIVE  FAILURE  RATES, 
PRODUCTION  AIRCRAFT 


Tim  Period 

TTTqiT 

Hours 

!  Syste*  Failures  1 

i  ram/log  i 

Tote] 

Fleet 

1  MH/L06  1 

■■irmiirmaH 

i|i  ■ 

uMnniirmiUi 

No. 

Cue. 

No. 

Cue. 

NO. 

Cia. 

No. 

Cue 

ITT 

Cue. 

No. 

WT 

Dec  78  -  Feb  79 

47 

47 

47 

47 

74 

74 

74.0 

74.0 

1.57 

91 

91 

91.0 

91.0 

Nar  79  -  May  79 

168 

216 

373 

420 

IIS 

192 

262.0* 

336.0 

.80 

137 

228 

395.2 

m 

Jun  79  -  Aug  79 

279 

494 

828 

1248 

131 

323 

389.1* 

725.1 

.58 

199 

427 

591.0 

986.2 

.79 

Sep  79  -  Nov  79 

686 

1180 

1909 

3157 

289 

612 

.48 

410 

837 

1141.0 

2127.2  • 

.67 

Oec  79  -  Feb  80 

372 

1652 

2611 

5768 

106 

718 

.39 

126 

963 

884.1 

3011.3 

.52 

Mar  80 

988 

2540 

1302 

7070 

189 

907 

249.2* 

.36 

235 

1198 

309.8 

3321.1 

.47 

‘Extrapolated  frou  RAM/LOG  data. 


The  reliability  growth  rates  implied  by  Figure  13  (0.29 
for  system  failures,  0.27  for  operational  failures)  are  about 
twice  the  pre-GCT  rate.  Because  of  the  linearity,  instanta¬ 
neous  rate  curves  are  also  linear,  lying  parallel  to  and  below 
the  cumulative  rate  curves  shown  in  the  Figure.  The  instanta¬ 
neous  system  failure  rate  curve  is  shown  in  Figure  9  (although 
the  linearity  disappears  when  the  curve  is  translated  to 
account  for  the  prototype  flight  hours). 

The  instantaneous  failure  rate  curves  also  appear  in 
Figure  14,  which  also  shows  the  contributions  of  the  individual 
groups  of  production  aircraft  comprising  the  data  sample.  Note 
that  the  first  few  production  aircraft,  with  the  exception  of 
the  one  RAM-D  aircraft,  were  worse  than  the  trend  line  would 
indicate,  with  a  system  failure  rate  of  more  than  1  per  hour. 
Also  note  that  the  early  flight  hours  on  the  second-year  pro¬ 
duction  aircraft  revealed  a  system  failure  rate  close  to  0.2 
per  hour  (MTBF  =  5  hours),  whereas  the  aggregate  trend  passes 
through  about  0.25  system  failures  per  hour  at  the  same  flight- 
hour  level.  Finally  it  should  be  noted  that  the  high  failure 
rate  of  the  RAM-D  aircraft  in  the  June  1979  to  September  1979 
time  frame  is  a  result  of  environmentally  induced  failures  in 
desert  testing  at  Yuma  Proving  Ground,  Arizona. 
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( 4 )  Comparison  with  AMSAA  Analysis 

The  system  reliability  growth  history  as  measured  by  AMSAA 
[43]  is  shown  in  Figure  15.  Their  approach  has  been  to  compute 
failure  rates  over  approximately  equal  blocks  of  flight  hours. 
In  the  Figure,  flight  hours  shown  are  only  those  actually 
sampled,  and  "SDC"  corresponds  to  what  we  have  referred  to  as 
"modified  RAM/LOG"  in  Section  C.l  above.  Comparing  their  'com¬ 
puted  values  with  ours,  the  conclusions  are  quite  similar. 
During  the  maturity  phase,  Figure  15  shows  a  worsening  trend, 
whereas  the  failure  rate  appeared  constant  to  us;  the  final 
maturity  phase  and  initial  production  phase  values  are  approxi¬ 
mately  the  same  in  both  analyses.  During  the  production  phase, 
AMSAA  shows  a  higher  MTBF  at  the  conclusion  of  the  FDTE  pro¬ 
gram;  our  analysis  shows  more  rapid  reliability  growth  since 
then. 


Figure  15.  AMSAA  MEASUREMENTS  OF  BLACK  HAWK 
SYSTEM  RELIABILITY  GROWTH  HISTORY 


77 


b .  Mission  Reliability 

The  31ack  Hawk  instantaneous  abort  rate  history  is  shown 
in  Figure  16.  As  was  the  case  with  the  system  failure  rate, 
the  abort  rate  improves  through  GCT  (growth  rate  =  0.47),  jumps 
to  a  higher  and  relatively  constant  level  for  the  maturity 
phase,  and  then  again  shows  improvement  during  the  production 
phase.  Unlike  system  reliability,  however,  it  does  not  appear 
that  the  program  goal  (abort  rate  =  0.013)  will  be  achieved  if 
the  present  rate  of  growth  continues. 


100  1000  10000 

CUMULATIVE  FUGHT  HOURS 

MMM-11 

Figure  16.  INSTANTANEOUS  ABORT  RATE  TRENDS 
OVER  TIME  FOR  THE  BLACK  HAWK 

Figure  17  presents  the  cumulative  abort  rate  plot  of 
the  RAM/LOG  data  superimposed  on  the  fleet  flight-hour  his¬ 
tory.  Figure  IS  focuses  just  on  the  abort  rate  data  versus 
flight  hours  for  the  production  aircraft.  As  with  system 
reliability,  the  trend  is  approximately  linear  (slope  =  0.12). 
The  data  displayed  in  Figures  17  and  18  are  shown  in  Table  13- 
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CUMULATIVE  ABORT  RATE 
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Figure  17.  CUMULATIVE  ABORT  RATE  TRENDS  OVER  TIME  FOR 
THE  BLACK  HAWK 
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Figure  18.  CUMULATIVE  ABORT  RATE  VERSUS 
FLIGHT  HOURS  FOR  PRODUCTION 
BLACK  HAWK 


Table  13.  BLACK  HAWK  CUMULATIVE  ABORT  RATES,  TOTAL  SYSTEM 
AND  PRODUCTION  AIRCRAFT 


Hiqnt  Hours 

“iSSipn  Aior 

ts 

C  jrulat* ve 

RAM/!.  36 

Total 

Fleet 

RAM/!. 

n. 

Total 

Fleet 

Abort  *ate 

Time 

Period 

No. 

Cum. 

NO. 

Cum. 

NO. 

NO. 

Cum. 

Total  r‘eet 

"otal  System 

Jun  75  -  Aug  75 

3 

3 

3 

3 

1 

i.o 

1.0 

.385** 

Sep  75  - 

Nov  75 

98 

101 

98 

101 

13 

!  13.0 

14.0 

.139 

Oec  75  - 

Feo  76 

a 

101 

0 

101 

0 

[  0.0 

14.0 

.139 

Mar  76  - 

fay  76 

283 

383 

283 

383 

16 

j  16.0 

30.0 

.078 

Juft  76  - 

Aug  76 

273 

656 

273 

656 

7 

7.0 

37.0 

.056 

Sep  76  - 

Nov  76 

4 

660 

4 

660 

0 

0.0 

37.0 

.056 

Oec  76  - 

Feb  77 

a 

660 

3 

660 

0 

i  0.0 

37.0 

.056 

far  77  - 

May  77 

1 56 

816 

156 

316 

3 

!  3.0 

40.0 

.049 

i  Jun  77  - 

Aug  77 

68 

884 

63 

884 

3 

1  3.0 

43.0 

.049 

Sep  77  - 

Nov  77 

148 

1032 

148 

1032 

10 

j  10.0 

53.0 

.051 

Dec  77  - 

Feb  78 

137 

1169 

137 

1169 

5 

1  5-3 

58.0 

.050 

far  73  - 

May  78 

76 

1244 

76 

1244 

0 

i  °-a 

58.0 

.047 

Jun  78  - 

Aug  78 

3 

1248 

3 

1248 

1 

1.0 

59.0 

.047 

Sep  73  - 

Nov  78 

185 

1432 

185 

1432 

13 

!  13.0 

72.3 

.050 

Zee  78  - 

Feb  79 

133 

1565 

133 

1565 

15 

;  15.0 

87.0 

.056 

M»r  JZ  - 

May  79 

,71 

1736 

376 

1941 

? 

;  20.0* 

107.0 

.355 

Jun  73  - 

Aug  79 

279 

2015 

328 

2769 

16 

|  47.5* 

154.5 

.056 

Seo  79  - 

Nov  79 

586 

2701 

1909 

4678 

29 

1  30.7* 

235.2 

.050 

Dec  73  - 

Feo  30 

372 

3073 

2511 

7289 

18 

;  126.3* 

361.5 

.050 

Mar 

30 

388 

4061 

1302 

8591 

36 

■  47.5* 

409.0 

.048 

Production 

Dec  78  - 

Aircraft  Only 

Feo  79 

47 

47 

V 

4 

! 

I 

4.0 

.085 

far  79  - 

May  79 

168 

215 

373 

420 

9 

20.0* 

24.0 

.057 

Jun  79  * 

Aug  79 

279 

494 

828 

1248 

16 

1  47.5* 

71.5 

.057 

Seo  79  • 

Nov  79 

686 

1180 

1909 

3157 

29 

!  30.7* 

152.2 

.048 

Dec  ’9  - 

-eo  80 

372 

1552 

2611 

5768 

18 

:  126.3* 

278.5 

.048 

Mar 

30 

988 

2540 

1302 

7070 

» 

!  47.5* 

326.0 

.046 

*5xtraoolated  from  RAM/LOG  data. 


•  • 

flignt  iour  totals  are  rounded  to  tne  nearest  integer  for  presentation  in  this  Table. 
Cumulative  aoort  rates  were  computed  using  cumulative  flight  hour  totals  expressed  to 
one  decimal  place  le.g. .  cumulative  abort  rate  of  .385  is  computed  based  on  2.6  flignt  hours). 


Finally,  Figure  19  displays  the  instantaneous  abort  ra^e  curve 
corresponding  to  the  cumulative  graph  in  Figure  18  along  with 
the  individual  contributions  of  the  programs  comprising  the 
data  sample. 
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Figure  19.  COMPARISON  OF  ESTIMATED  INSTANTANEOUS  ABORT 
RATE  TREND  WITH  MEASURED  VALUES  FOR  BLACK 
HAWK  PRODUCTION  AIRCRAFT  GROUPS 


c  .  A  v  a  i  1  a  b  i  1  i ty 

Cumulative  achieved  availability  vs  flight  hours  is  plotted 
in  Figure  20.  The  same  characteristics  exhibited  by  the  two 
reliability  parameters  above  are  exhibited  by  this  parameter 
as  well — growth  through  GCT,  deterioration  during  maturity, 
and  growth  again  during  production.  The  production  aircraft 
only  data  are  shown  in  Figure  21.  The  data  plotted  in  Figures 
20  and  21  are  given  in  Table  14 .  Referring  to  that  Table,  of 
the  965  flight  hours  and  905.7  maintenance  hours  recorded 
during  the  period  June  1979  through  November  1979,  740  flight 
hours  and  583-5  maintenance  hours  were  contributed  by  the  FDTE 
aircraft.  The  latter  values  equate  to  an  achieved  availability 
of  0.925.  Thus,  the  threshold  of  0.92,  as  defined  in  Section 
3.2,  was  crossed  at  the  end  of  the  FDTE  program.  The  0.92  goal 
corresponds  to  approximately  0.35  hours  of  (on-aircraft)  mainte¬ 
nance  downtime  per  flight  nour ;  the  FDTE  program  cumulative 


CUMULATIVE  ACMEVED  AVAK.AMUTT 


Figure  20.  CUMULATIVE  ACHIEVED  AVAILABILITY  TRENDS 
OVER  TIME  FOR  THE  BLACK  HAWK 


Figure  21.  CUMULATIVE  ACHIEVED  AVAILABILITY  VERSUS 
FLIGHT  HOURS  FOR  PRODUCTION  BLACK  HAWK 
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Table  14.  BLACK  HAWK  CUMULATIVE  ACHIEVED  AVAILABILITIES 
TOTAL  SYSTEM  AND  PRODUCTION  AIRCRAFT 


tjn.'.ii-  .e 


FI iqnt  Hours 

Maintenance  iours 

Acmevea 

TocaJ 

Fleet 

xSmTTjG 

Total 

leet 

ivai  ’.aci  ’ '?/ 

Time  3ertod 

MO. 

Cum. 

No. 

Cjs. 

No. 

NO. 

Cum. 

"otai  r*eet 

Total  System 

Cun  75  -  Aug  75 

3 

3 

3 

3 

14.7 

14.7 

14.7 

.  47  *• 

Sep  75  -  Nov  75 

98 

101 

98 

101 

135.9 

135.9 

150.6 

.56 

Dec  75  -  Feb  75 

0 

101 

0 

101 

0.0 

0.0 

150.6 

.56  * 

Mar  76  -  fay  76 

083 

383 

283 

383 

119.4 

119.4 

270.0 

.93 

J  un  76  -  Aug  76 

273 

656 

273 

556 

146.2 

146.2 

416.2 

.94 

Sep  76  -  Mov  76 

4 

660 

i 

660 

2.6 

2.6 

418.8 

.94 

Oec  76  -  Feb  77 

0 

660 

a 

660 

0.0 

0.0 

418.8 

.94 

Her  77  -  May  77 

156 

316 

156 

316 

104.9 

104.9 

523.7 

.94 

Jun  77  -  Aug  77 

68 

384 

63 

384 

74.2 

74.2 

597.9 

.34 

Sep  77  -  Mov  77 

148 

1032 

148 

1032 

331.3 

331.3 

929.2 

.32 

Oec  77  -  Feb  78 

137 

1169 

137 

1169 

148.5 

148.5 

1077.7 

.91 

Mar  78  -  May  78 

76 

1245 

76 

1245 

280.4 

280.4 

1358.1 

.90 

Jun  78  -  Aug  78 

3 

1248 

3 

1248 

367.2 

367.2 

1725.3 

•  37 

Seo  78  -  Nov  73 

185 

1432 

185 

1432 

315.1 

315.1 

2040.4 

.57 

Oec  78  -  Fen  79 

133 

1565 

133 

1565 

517.1 

517.1 

2557.5 

.86 

Mar  79  -  May  79 

171 

1736 

376 

1941 

277.5 

610.9* 

3168.4 

.35 

Jun  79  -  Aug  79 

279 

2015 

328 

2769 

350.4 

1040.6* 

4209.0 

.36 

Seo  79  -  Nov  79 

686 

2701 

1909 

4678 

555.3 

1539.4* 

5748.5 

.38 

Oec  79  -  Mar  80 

1360 

4061 

3913 

8591 

462.3 

1330.4* 

7078.9 

.92 

!  'reduction  Aircraft  Only 
Oec  78  -  Feb  79 

47 

47 

47 

47 

434.0 

434.0 

434.0 

.13 

Mar  79  -  May  79 

168 

215 

373 

420 

273.2 

606.6* 

1036.6 

.77 

1  Jun  79  -  Aug  79 

279 

494 

828 

1248 

350.4 

1040.6* 

2077.2 

.34 

Seo  79  -  Nov  79 

686 

1180 

1909 

3157 

555.3 

1539.4* 

3616.6 

.39 

Oec  79  -  Mar  80 

1360 

2540 

3913 

7070 

462.3 

1330.4* 

4947.0 

.93 

'Sxtrapclated  from  SAM/LOG  aata. 


**e1ignt  hour  totals  ar*  rounded  to  the  nearest  integer  for  oresentation  in  this  Table. 
Cumulative  achieved  availabilities  were  comouced  using  cumulative  flfgnt  hour  totals 
expressed  to  one  decimal  place. 


average  was  0.30  hours  per  flight  hour.  The  data  shown  in 
Table  14  for  the  period  December  1979  through  March  1980  were 
recorded  for  the  group  of  second-year  production  aircraft. 

Those  data  show  a  ratio  of  maintenance  downtime  to  flight  hours 
of  0.34,  with  a  corresponding  achieved  availability  of  0.97. 
Finally,  referring  again  to  Figure  21,  the  low  (0.129)  initial 
value  plotted  in  the  Figure  comes  from  the  early  flight  hours 
of  the  single  RAM-D  aircraft;  after  twelve  months  of  the  RAM-D 
program;  however,  that  aircraft  was  achieving  availability  of 
0.3  (690.6  maintenance  hours  for  320  flight  hours). 

S3 


d .  Ma i nta inabi 1 i ty 

( 1 )  Unscheduled  Maintenance  Events 

Unscheduled  maintenance  events  are  all  those  events 
resulting  in  corrective  maintenance  manhours,  as  defined  in 
Section  B.2  above.  The  cumulative  rates  of  such  events  are 
plotted  versus  flight  hours  in  Figure  22.  The  production .air¬ 
craft  data  only  are  shown  in  Figure  23-  The  data  used  to 
generate  those  figures  are  given  in  Table  15-  As  is  the  case 
with  the  other  RAM  parameters,  growth  through  GCT,  deteriora¬ 
tion  during  maturity,  and  growth  again  during  production  char¬ 
acterize  this  parameter.  However,  in  comparing  the  improve¬ 
ment  of  the  unscheduled  maintenance  action  rate  with  that  of 
the  system  failure  rate  through  GCT  and  again  during  the  pro¬ 
duction  phase,  it  is  interesting  to  note  that  the  former 
parameter  had  about  twice  the  growth  rate  through  GCT  as  the 
latter  parameter  (0.24  versus  0.13),  but  a  slower  growth  rate 
(3.25  versus  0.29)  during  production.  The  ratio  of  cumulative 
unscheduled  maintenance  actions  to  cumulative  system  failures 
decreased  during  GCT  from  approximately  3-9  at  the  beginning 
to  3.2  at  the  end.  During  production,  the  ratio  has  increased 
from  approximately  2.0  to  2.5  at  the  3,500  flight-hour  point. 

( 2 )  Maintenance  Manhours 

The  cumulative  unscheduled  maintenance  manhours  per  flight 
hour  data  versus  flight  hours  are  shown  in  Figure  24.  The 
same  characteristics  exhibited  by  the  previous  RAM  parameters 
are  evident  in  this  Figure  as  well,  although  the  Improvement 
in  this  parameter  during  the  production  phase  appears  quite 
dramatic.  The  RAM/LOG  data  for  production  aircraft  only  are 
displayed  in  Figure  25.  The  data  comprising  Figures  24  and 
25  are  given  in  Table  16. 
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Figure  23.  CUMULATIVE  UNSCHEDULED  MAINTENANCE  ACTIONS  PER  FLIGHT 
HOUR  FOR  PRODUCTION  BLACK  HAWK 
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Table  15.  BLACK  HAWK  CUMULATIVE  UNSCHEDULED  MAINTENANCE 
ACTION  RATES,  TOTAL  SYSTEM  AND  PRODUCTION 
AIRCRAFT 


Time  Period 

FTfgftt  Hours 

T 

Unscheduled  Maintenance  j 

Actions  1 

Cumulative 
unscheduled 
Maintenance 
Action  Rate 

RAM/LOG 

Total 

Fleet 

ram/log 

Total 

Fleet  [ 

NO. 

Cum. 

No. 

Cue. 

NO. 

NO. 

1  Cun.  ' 

Total  Fleet 

Total  System 

Jun  75  -  Aug  75 

3 

3 

3 

3 

9 

9 

9  i 

3.46** 

Seo  75  -  Nov  75 

98 

101 

98 

101 

173 

173 

1  182  ; 

1.81 

Dec  75  -  Feb  76 

0 

101 

0 

101 

0 

0 

182  1 

1.3! 

Mar  76  -  May  76 

383 

383 

283 

383 

339 

339 

i  521 

1.36 

Jun  76  -  Aug  76 

273 

656 

273 

656 

231 

231 

752 

1.15 

Sep  76  -  Nov  76 

A 

660 

4 

660 

0 

0 

752 

1.14 

Oec  76  -  Feb  77 

0 

660 

0 

660 

0 

0 

i  752  ; 

1.14 

Mar  77  -  May  77 

156 

816 

156 

816 

214 

214 

i  966 

1.18 

Jun  77  -  Aug  77 

68 

884 

68 

884 

150 

150 

1116 

1.26 

Sep  77  -  Nov  77 

148 

1032 

148 

1032 

374 

374 

U90 

1.44 

Dec  77  -  Feb  78 

137 

1169 

137 

1169 

240 

240 

1730 

1.48 

Mar  78  -  May  78 

76 

1244 

76 

1244 

273 

273 

2003  ; 

1.61 

Jun  78  -  Aug  78 

3 

1248 

3 

1248 

358 

358 

2361 

1.89 

Sep  78  -  Nov  78 

185 

1432 

185 

1432 

356 

356 

2717 

1 .90 

Oec  78  *  Peo  79 

133 

1565 

133 

1565 

235 

235 

2952 

1.89 

Mar  79  -  May  79 

171 

1736 

376 

1941 

234 

513.4* 

3465.4 

1.79 

Jun  79  -  Aug  79 

279 

2015 

828 

2769 

413 

1226.6* 

4692.3 

1.69 

See  79  -  nov  79 

686 

2701 

1909 

4678 

747 

2078.3* 

;  6770.7 

1  .45 

Oec  79  -  Feb  aa 

372 

3073 

2611 

7289 

249 

1747.2* 

8518.0 

1.17 

Mar  30 

988 

4061 

1302 

8591 

406 

535.3* 

'  9053.2 

1.05 

Production  Aircraft  Only 

Dec  78  -  Feb  79 

47 

47 

47 

47 

164 

164 

'64 

3.49 

Mar  79  -  May  79 

168 

215 

373 

420 

229 

508.4* 

672.4 

1  .60 

Jun  79  -  Aug  79 

279 

494 

523 

1248 

413 

1226.6* 

1399.3 

1.52 

Seo  79  -  Nov  79 

666 

1180 

1909 

3157 

747 

2078.3* 

397'. 3 

1.25 

Dec  79  -  Feo  30 

372 

1552 

2611 

5768 

249 

1747.3* 

5725.3 

0.99 

Mar  30 

986 

2540 

1302 

’070 

406 

535.3* 

6260.3 

3.39 

*5xtraoo1aced  from  3AM/ LOG  data. 


FUgnt  dour  totals  are  rounded  to  tbe  nearest  integer  'or  oresentatlon  in  tnis  Table. 
Cumulative  unscnedulefl  maintenance  action  rates  were  conduced  using  emulative  'lignt  nour 
totals  expressed  to  one  decimal  glace. 
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cumulative  flight  hours,  total  system 


Figure  24.  CUMULATIVE  CORRECTIVE  MAINTENANCE  MANHOURS 
PER  FLIGHT  HOUR  VERSUS  FLIGHT  HOURS  FOR 
THE  BLACK  HAWK  PROGRAM 


r  s 
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Figure  25.  CUMULATIVE  CORRECTIVE  MAINTENANCE  MANHOURS 
PER  FLIGHT  HOUR  VERSUS  FLIGHT  HOURS 
FOR  PRODUCTION  BLACK  HAWK 
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Table  16.  CUMULATIVE  CORRECTIVE  MAINTENANCE  MANHOURS  PER 

FLIGHT  HOUR,  TOTAL  SYSTEM  AND  PRODUCTION  AIRCRAFT 


i 

FI  ight 

Hours 

Corrective  Maintenance 
Manhours  fAVUM  +  AVIM) 

Cunulati  ve 

■Min  ■arm 

■EiHPTH 

Total 

FI  eet 

MMH/FH 

Time  Period 

No. 

Cum. 

No. 

Cum. 

No. 

NO. 

Cum. 

Total  Fleet 

1  Total  System 
!  Jun  75  -  Aug  75 

3 

3 

3 

3 

9.3 

9.8 

9.8 

3.78** 

i  Sep  75  -  Nov  75 

98 

101 

98 

101 

215.6 

215.6 

225.4 

2.24 

j  Dec  75  -  Feb  76 

0 

101 

0 

101 

0.0 

0.0 

225.4 

2.24 

!  Mar  76  -  May  76 

283 

383 

283 

383 

330.8 

330.8 

556.2 

1.45 

Jun  76  -  Aug  76 

273 

656 

273 

656 

290.7 

290.7 

846.9 

1.29 

Sep  76  -  Nov  76 

4 

660 

4 

660 

11.8 

11.8 

858.7 

1.30 

Dec  76  -  Feb  77 

0 

660 

0 

660 

0.0 

0.0 

858.7 

1.30 

Mar  77  -  May  77 

156 

816 

156 

816 

214.9 

214.9 

1073.6 

1.32 

Jun  77  -  Aug  77 

68 

884 

68 

884 

165.7 

165.7 

1239.3 

1.40 

Sep  77  -  Nov  77 

148 

1032 

148 

1032 

795.9 

795.9 

2035.2 

1.97 

Oec  77  -  Feb  78 

137 

1169 

137 

1169 

404.2 

404.2 

2439.4 

2.09 

Mar  78  -  May  78 

76 

1244 

76 

1244 

547.1 

547.1 

2986.5 

2.40 

Jun  78  -  Aug  78 

3 

1248 

3 

1248 

496.4 

496.4 

3482.9 

2.79 

Sep  78  -  Nov  78 

185 

1432 

185 

1432 

534.3 

534.3 

4017.2 

2.80 

Dec  78  -  Feb  79 

133 

1565 

133 

1565 

301.5 

301.5 

4318.7 

2.76 

Mar  79  -  May  79 

171 

1736 

376 

1941 

308.3 

681.5* 

5000.2 

2.58 

!  Jun  79  -  Aug  79 

279 

2015 

828 

2769 

516.2 

1533.1* 

6533.2 

2.36 

Sep  79  -  Nov  79 

686 

2701 

1909 

4678 

813.9 

2264.1* 

3798.1 

1.88 

j  Dec  79  -  Feb  80 

372 

3073 

2611 

7289 

457.0 

3206.7* 

12004.9 

1 .65 

Mar  80 

988 

4061 

1302 

8591 

597.2 

787.3* 

12792.2 

1 .49 

Production  Aircraft  Only 

Oec  78  -  Feb  79 

47 

47 

47 

47 

255.7 

255.7 

255.7 

5.43 

Mar  79  -  May  79 

168 

215 

37' 

420 

305.4 

678.1* 

933.8 

2.22 

Jun  79  -  Aug  79 

279 

494 

828 

1248 

516.2 

1533.1* 

2466.8 

1 .98 

Sep  79  -  Nov  79 

686 

1180 

1909 

3157 

813.9 

2264.1* 

4731.7 

1 .50 

Dec  79  -  Feo  SO 

372 

1552 

2611 

5768 

457.0 

3206.7* 

7938.5 

1.38 

Mar  30 

988 

2540 

_ 

1302 

7070 

597.2 

787.3* 

3725.8 

1.23 

•Extrapolated  from  SAM/IOG  data. 


**clignt  oour  totals  are  rounded  to  the  nearest  integer  for  presentation  In  this  Table. 
Cumulative  MMH/FH  values  were  computed  using  cumulative  flight  hour  totals  expressed 
to  one  decimal  place. 


In  order  to  compare  the  improvement  in  system  failure 
rate  during  production  (Figure  13)  and  the  improvement  in 
unscheduled  maintenance  events  during  production  (Figure  23) 
with  the  MMH/FH  improvement  shown  in  Figure  25,  let  t  denote 
flight  hours,  and  define 

M(t)  =  cumulative  maintenance  manhours 

4 

N^(t)  a  cumulative  failures 

( t )  =  cumulative  unscheduled  maintenance  events. 

From  Figures  13  and  23, 

N.(t)  -a. 

-i- —  a  A^t  1,  i=l , 2  , 


and  from  Figure  25, 


as  a  -  b-log  t  , 


where  (\  (A2,a2)  and  (a,b)  are  estimated  by  (4.7,  C.29) 

(3.6,  0.25),  and  (4.4,  0.82)  respectively.  Finally,  let 

Y  (t)  =  cumulative  maintenance  manhours  per  failure 

Y.  (t)  =  instantaneous  maintenance  manhours  oer  failure. 
In 


so  that 


M(t) 


with  analogous  formulas  holding  for  maintenance  manhours  per 
unscheduled  maintenance  event.  Using  the  parameter  estimates 
given  above,  Yc(t)  and  Y^n(t)  are  plotted  over  the  sample 
flight-hour  range  in  Figure  26.  From  the  Figure  we  see  that 
maintenance  manhours  expended  per  failure  has  remained  rela¬ 
tively  constant  throughout  the  first  7,000  production  flight 
hours,  rising  slightly  for  the  first  3>000  and  declining  . 
slightly  for  the  last  4,000.  The  same  behavior  but  with  even 
less  variability  can  be  observed  for  maintenance  manhours  per 
maintenance  event.  In  either  case,  one  can  conclude  that  if 
learning  resulting  in  more  efficient  maintenance  practices  has 
occurred,  it  has  been  counterbalanced  by  failures  requiring 
more  maintenance  manhours  to  fix.  The  findings  of  Figure  26 
are  supported  by  the  mean  time  to  repair  production  data,  as 
shown  in  Figure  27.  Over  the  sample  period,  the  MTTR  has 
remained  approximately  constant. 

On  the  other  hand,  the  MMH/FH  values  have  remained  well 
below  the  program  goal  of  2.8.  During  GOT,  reference  [44] 
offered  some  possible  reasons  for  the  low  demonstrated  value 
(1.56  corrective  MMH/FH),  Including  deferred  maintenance  of 
some  items  because  of  pending  design  changes,  contractor- 
performed  maintenance  which  was  not  counted,  and  low  numbers 
of  flight  hours  on  the  prototypes  at  the  time.  Whether  any 
of  those  reasons  remain  valid,  particularly  low  flight  hours 
on  individual  production  aircraft  and  deferred  maintenance 
time,  cannot  be  determined  until  more  data  have  been  collected. 
The  first  periodic  inspection  on  each  Black  Hawk  aircraft 
does  not  occur  until  507  flight  hours  have  been  logged. 

e .  Anal  ysis  of  UMSDC  Data 

The  UMSDC  data  system  is  designed  to  collect,  process, 
and  analyze  logistics  management,  equipment  performance,  and 
maintenance  performance  data  on  specified  percentages  of 
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MAN  HOURS 


Figure  26.  MAINTENANCE  MANHOURS  PER  FAILURE  AND  MAINTENANCE 
MANHOURS  PER  UNSCHEDULED  MAINTENANCE  EVENT  TRENDS 
DERIVED  FROM  PRODUCTION  BLACK  HAWK  RAM/LOG  DATA 
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Figure  27.  CUMULATIVE  MEAN  TIME  TO  REPAIR  VERSUS  FLIGHT 
HOURS  FOR  PRODUCTION  BLACK  HAWK 

fielded  fleet  populations.  A  large  fraction  of  the  Black  Hawk 
fleet  is  currently  being  monitored  under  this  data  system. 

The  data  furnished  IDA  are  summarized  in  Table  17. 

Note  that  while  unscheduled  maintenance  events,  mission 
aborts,  and  unscheduled  maintenance  manhours  are  tracked  by 
the  UMSDC  system,  the  primary  parameter  receiving  management 
attention  during  the  development  phase — system  reliability — 
is  not  (or  if  it  is,  current  system  software  is  not  designed 
to  extract  It  from  the  data  base).  Furthermore,  a  comparison 
of  UMSDC  data  with  RAM/LOG  data  suggests  that  at  least  the 
first  two  parameters  noted  above  are  not  measured  under  the 
two  systems  in  a  consistent  manner.  In  particular,  the  eight 
FDTE  aircraft  (the  first  eight  aircraft  listed  in  Table  17) 
were  monitored  for  consecutive  and  approximately  equal  flight- 
hour  time  periods  by  the  two  systems.  The  data  appear  in 
Table  13  below. 

a  o 


Table  17.  BLACK  HAWK  UMSDC  DATA  AS  OF  JUNE  1980 


Aircraft 

FI  ight 
Hours 

Unscneduled  i 
Maintenance 
Events 

Mission 

Aborts 

Unscneduled 

Maintenance 

Manhours 

First-Year  Aircraft 

1 

7722721 

191 

92  : 

2 

243.7 

7722722 

203 

106  : 

5 

362.2 

j 

7722723 

237 

1 27 

2 

212.1 

7722724 

90 

56 

3 

j 

118.4 

7722725 

160 

101 

2 

209.1 

7722727 

162 

79 

3 

192.9 

7722728 

260 

108 

2 

208.2 

Second-Year  Aircraft 

7822960 

254 

95 

4 

210.4 

7822961 

366 

96 

1 

126.5 

7822962 

156 

75 

4 

154.8 

7822966 

256 

136 

6 

373.5 

7822967 

154 

102 

2 

295.4 

782296a 

190 

91 

i 

1 

183.6 

7822969 

1  220 

123 

1 

191.4 

7822970 

177 

98 

3 

206.7 

j 

7822984 

62 

I 

10 

| 

0 

11.3 

7822986 

104 

36 

0 

91.6 

7822989 

51 

0 

0 

0.0 

7822990 

;  125 

45 

2 

j  143.1 

7822991 

96 

69 

2 

165.2 

7822993 

126 

53 

1 

131.0 

7822995 

130 

44 

0 

66.6 

7822996 

64 

41 

1 

102.6 

7822997 

14 

18 

0 

24.2 

7822998 

161 

33 

0 

61.5 

7822999 

66 

41 

5 

83.9 

7823000- 

89 

41 

1 

103.1 

7823001 

82 

26 

1 

39.1 

7823002 

60 

18 

0 

50.4 

7823003 


22 


2 


0 


3.3 


Table  18.  COMPARISON  OF  RAM/LOG  AND  UMSDC  DATA  COLLECTED 
ON  FDTE  AIRCRAFT 


Time  Period 

PJ 

FI  ight 
Hours 

System 

Failures 

Unscheduled 

Maintenance 

Events 

Mission 

Aborts 

Maintenance 

Manhours 

May  79  -  Sep  79 

RAM/ LOG 

740 

255 

736 

32 

833.7 

Oct  79  -  Mar  80 

UMSDC 

742 

— 

404 

7 

911.3 

Apr  80  -  Jun  80 

UMSDC 

815 

— 

360 

16 

845.7 

The  apparent  discrepancy  in  unscheduled  maintenance  event 
reporting  evident  in  Table  18  stems  from  two  possible  causes. 
First,  mechanics  themselves  are  responsible  for  reporting 
maintenance  events  under  UMSDC  data  collection,  and  it  is 
likely  that  many  minor  events  (e.g.,  tightening  a  loose  screw) 
go  unreported  due  to  the  paperwork  involved.  Second,  other 
le  3  critical  repairs  may  be  deferred  until  the  phased  inspec¬ 
tions,  the  first  of  which  does  not  occur  until  500  flight  hours. 
The  discrepancy  in  mission  abort  reporting  was  explained  by 
TSARCOM  personnel  as  a  definitional  problem.  Under  RAM/LOG, 
a  large  number  of  mission  aborts  were  precautionary  landings 
caused  by  chip  detector  lights.  Under  UMSDC,  if  such  a  landing 
is  made,  the  chip  detectors  are  often  removed,  checked,  cleaned 
off,  and  replaced,  and  the  mission  resumed  with  no  abort 
charged  if  the  resulting  delay  is  less  than  30  minutes.  (As 
of  this  writing,  the  UMSDC  data  are  being  changed  to  label  such 
events  aborts  as  under  RAM/LOG.)  Finally,  although  not  apparent 
in  Table  13 ,  TSARCOM  personnel  felt  that  more  maintenance  man¬ 
hours  would  be  reported  for  comparable  tasks  under  UMSDC  than 
under  RAM/LCG  because  hands-on  time  would  not  be  as  carefully 
monitored  under  the  former  system.  (For  example,  if  a  mechanic 
stops  to  smoke  a  cigarette  while  performing  a  maintenance  action, 
RAM/LOG  data  collectors  will  stop  recording  maintenance  time, 
but  the  mechanic ,  in  reporting  under  UMSDC,  is  likely  to  include 
such  short  breaks  in  his  labor  total  for  the  maintenance  event . ) 


For  the  above  reasons,  we  used  the  UMSDC  data  only  to 
compare  the  first-year  aircraft  with  second-year  aircraft. 
The  data  of  Table  17  are  summarized  in  aggregated  form  in 
Table  19. 

Table  19.  COMPARISON  OF  FIRST-YEAR  AND  SECOND-YEAR 
BLACK  HAWK  USING  UMSDC  DATA 


Aircraft 

Flight 

Hours 

Unscheduled  Maintenance 
Events  per  Flight  Hour 

Aborts  per 
Flight  Hour 

Unscheduled 
Maintenance 
Manhours  per 

FI ight  Hour 

First-Year 

1303 

0.513 

0.0146 

1.19 

Second-Year 

3026 

0.427 

0.0116 

0.93 

Total 

4329 

0.453 

0.0125 

1.01 

The  difference  between  unscheduled  maintenance  event 
rates  and  first-  and  second-year  aircraft  has  rather  high 
statistical  signif icance,  while  the  difference  in  abort  rates 
is  of  slightly  lower  significance.1  As  in  Section  C.d.2 
above,  the  improvement  in  MMH/FH  due  to  the  improvement  in 
unscheduled  maintenance  events  per  flight  hour  can  be  deter¬ 
mined  by  computing  the  quantity  maintenance  manhours  per 
unscheduled  maintenance  event.  For  the  first-year  and 
second-year  aircraft  the  values  of  the  latter  quantity  are 


'Based  on  a  Wiicoxon  Rank  Sum  Test  [45,  p.  68]  of  the  ordered  system 
maintenance  event  rates  as  computed  from  Table  17.  If  all  the  aircraft 
in  Table  17  are  used,  the  hypothesis  of  equal  first-year  and  second-year 
unscheduled  maintenance  action  rates  is  rejected  at  the  0.06  level. 

(That  is,  if  the  computed  value  of  the  Wiicoxon  Rank  Sum  Test  statistic 
is  used  as  the  rejection  level  for  the  test  and  if  the  equality  hypothesis 
is,  in  fact,  true,  then  the  probability  of  a  false  conclusion  is  0.06.) 
Tsing  the  same  procedure  applied  to  abort  rates,  the  rejection  level  for 
the  hypothesis  of  equal  abort  rates  is  0.11. 
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2.31  and  2.18,  respectively.  Under  reasonable  assumptions, 
the  difference  in  these  two  values  is  of  rather  low  statisti¬ 
cal  significance.1 

Thus,  the  UMSDC  data  confirm  the  finding  of  Figure  26 
that  maintainability,  as  measured  by  maintenance  manhours  per 
unscheduled  maintenance  event,  seems  not  to  have  improved  as 
second-year  aircraft  entered  the  fleet. 

D.  SUMMARY 

Through  analysis  of  the  RAM/LOG  and  the  UMSDC  data,  a 
general  pattern  of  reliability,  availability,  and  maintain¬ 
ability  growth  can  be  observed.  RAM  appears  to  gradually 
improve  through  GCT  (approximately  700  contractor  plus  650 
Army  flight  hours),  remain  constant  throughout  the  Maturity 
Phase  of  the  program  (approximately  1,550  cumulative  Army 
flight  hours),  although  at  a  substantially  reduced  level  from 
that  measured  during  GCT,  and  then  appears  to  rapidly  improve 
during  the  Production  Phase.  The  lack  of  growth  (or  negative 
growth  according  to  [43]  during  the  Maturity  Phase  apparently 
did  not  imply  lack  of  growth,  or  even  slow  growth,  during 
the  Production  Phase.  Regarding  the  specific  RAM  parameters: 

(1)  The  System  Reliability  goal  of  4.0  hours  MT3F  seems 
to  have  been  achieved  with  the  second-year  production  aircraft. 
However,  the  second-year  production  aircraft  appear  to  be  more 
reliable  than  the  first-year  production  aircraft,  so  that  the 
Black  Hawk  fleet  as  a  whole  will  have  lower  reliability  than 
Figure  9  would  indicate. 


1  Assuming  that  the  number  of  manhours  recorded  during  each  maintenance 
event  for  each  aircraft  is  normially  distributed  with  mean  depending  upon 
the  production  year  of  that  aircraft,  and  variance  common  to  all  such 
recorded  events,  standard  theory  of  linear  models  [46]  can  be  used  to 
derive  a  t-test  for  equality  of  the  first-year  and  second-year  means. 
That  hypothesis  would  be  rejected  at  only  the  G.30  level. 


(2)  The  growth  rate  must  Improve  if  the  Mission  Reliability 
goal  is  to  be  met.  Either  the  system  reliability  and  mission 
reliability  goals  are  inconsistent,  or  the  managerial  emphasis 
placed  on  achieving  the  system  reliability  goal  caused  the  rate 
of  growth  in  mission  reliability  (e.g. ,  through  prioritization 
of  corrective  actions)  to  be  reduced. 

(3)  The  Operational  Availability  goal  as  defined  for  •the 
program  appears  to  have  been  met  by  the  production  aircraft. 
However,  regarding  the  definition  itself,  linearly  extrapolating 
from  peacetime  data  used  in  this  analysis  based  on  utilization 
rates  of  20-25  flying  hours  per  month  to  wartime  utilization 
rates  of  6 9  flying  hours  per  month  would  seem  to  be  an  overly 
simplistic  method  for  defining  operational  capability,  and  an 
area  worthy  of  more  detailed  study. 

(4)  Maintenance  Manhours  per  Flight  Hour  has  Improved  at 
a  rate  equivalent  to  the  rate  of  growth  in  System  Reliability. 
Mean  Time  to  Repair  does  not  appear  to  have  improved  during  the 
Production  Phase  of  the  program.  However,  measured  MMH/FH  has 
remained  well  below  the  program  goal  of  2.8. 


Section  II 


Boeing  Verto  1  YUH -  6 1  A  Re  liability 


The  YUH-61A  was  the  competitor  of  the  Sikorsky  YUH-60A 
for  the  Army  UTTAS  program.  Four  prototypes  of  each  competing 
design  were  built — three  under  Army  contract  and  one  with 
company  funding.  The  YUH-61A  accumulated  1,690  flight  hours 
through  the  OT  II  competitive  fly-off.  Following  OT  II,  the 
Sikorsky  YUH-60A  was  selected  and  the  YUH-61A  program  ended. 

Figure  28,  taken  directly  from  a  Vertol  report,  shows 
MT3F  for  the  three  Army-owned  aircraft  and  the  company-owned 
prototype  (COP).  It  indicates  an  improvement  in  MT3F  for  the 
individual  aircraft  from  less  than  one  hour  during  the  early 
flight  program  to  about  2.6  hours  prior  to  start  of  GCT. 
According  to  Boeing  Vertol  personnel,  the  MT3F  achieved  during 
GCT  was  3-0,  which  was  right  on  the  Boeing  Vertol  MTBF  pre¬ 
diction,  which  was  based  on  a  modified  Duane  approach. 

Figure  29,  taken  directly  from  a  Vertol  report,  shows 
the  cumulative  number  of  removals  versus  flight  hours  for 
the  YUH-61A  dynamic  components.  These  data  conform  closely 
to  the  Duane  equation 

c(t)  =  0.295(t)'0’ 36  . 


According  to  Boeing  Vertol  personnel,  the  MT3R  demonstrated 
during  GCT  was  in  fact  2,500  hours  as  predicted  from  3ED 
results . 
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Section  III 


Advanced  Attack  Helicopter  Reliability  and 
Ma i n ta i nab i 1 i t y  Characteristics 

In  September  1972,  in  response  to  the  report  of  a  special 
Army  Task  Force,  the  Advanced  Attack  Helicopter  (AAH)  program 
was  initiated.  The  Task  Force  had  been  formed  to  evaluate 
both  the  high  prospective  production  and  support  costs  of  the 
AH-56A  (Cheyenne)  weapon  system  under  development  for  the 
previous  six  years,  and  the  knowledge  gained  from  more  recent 
field  experiments  and  combat  operations  concerning  the 
increased  severity  of  the  enemy  anti-aircraft  threat  and  new 
tactics  envisioned  to  cope  with  that  threat.  The  result  was 
the  AAH  mission  need,  calling  for  an  aircraft  with  greater 
agility  and  hover  performance  than  the  Cheyenne,  but  with 
lower  speed,  payload,  firing  range,  navigation  and  gun  system 
accuracy  requirements,  and  also  an  aircraft  which  was  smaller, 
less  complex,  and  cheaper  to  operate  and  maintain. 

In  June  1973,  competitive  Phase  1  Engineering  Development 
contracts  were  awarded  to  Bell  Helicopter  Textron  and  Hughes 
Helicopter.  Each  contractor  was  to  design  and  fabricate  a 
static  test  article,  a  ground  test  vehicle,  and  two  flying 
prototypes.  The  competitive  fly-off  was  held  between  June  and 
September  1976,  during  which  time  each  contractor's  prototypes 
were  flown  for  approximately  150  flight  hours.  In  December 
1976,  Hughes  was  selected  as  the  winner  and  awarded  a  Phase  2 
Full-Scale  Engineering  Development  contract. 

The  Hughes  design,  designated  the  YAH-69,  is  a  tandem- 
seat  (pilot  aft),  four-bladed  aircraft  with  a  three-point 


conventional  wheel  landing  gear.  It  is  powered  by  twin 
General  Electric  T-700  engines  designed  and  developed  under 
separate  contract  as  Government  Furnished  Equipment  (GFE). 

Under  the  Phase  2  contract,  Hughes  was  to  modify  the  two 
Phase  1  prototypes,  fabricate  three  additional  air  vehicles, 
and  design  and  develop  and/or  test  and  integrate  the  mission 
subsystems,  including  the  2.75-inch  Folding  Fin  Aerial  Rocket 
( FFAR ) ,  the  HELLFIRE  Modular  Missile  System  ( HMMS ) ,  and  the 
Target  Acquisition  Designation  Sight/Pilot  Night  Vision  Sensor 
(TADS/PNVS).  Phase  2  flight  testing  began  in  November  1978 
and  is  planned  to  continue  through  August  1981.  The  total 
Phase  2  effort  is  planned  to  be  approximately  2,600  flight 
hours  and  1,200  ground  test  hours.  When  this  Phase  2  effort 
is  added  to  that  which  was  accomplished  during  Phase  1,  the 
totals  will  be  approximately  3,100  flight  hours  and  1,50^ 
ground  test  hours  [47].  Between  January  and  March  1980,  a 
competitive  TADS/PNVS  fly-off  was  held,  with  Martin  Marietta 
Corporation  being  selected  the  winner  over  Northrop  Corpora¬ 
tion.  DSARC  III  Is  anticipated  in  December  1981.  If  produc¬ 
tion  is  approved,  the  first  production  aircraft  will  be  com¬ 
pleted  In  November  1983. 

Reliability,  availability  and  maintainability  objectives 
have  been  established  for  the  AAH  program  as  follows  [48,  49, 

47]  : 

(1)  Mission  Reliability  -  probability  of  0.95  of  completing 
a  one-hour  mission.  Mission  start  is  defined  as  the 
beginning  of  preflight  and  completion  is  defined  as  a 
successful  landing  at  a  predetermined  point.  Failures 
detected  during  preflight  that  require  less  than  five 
minutes  to  fix  are  not  considered  mission  failures, 

nor  are  failures  of  expendable  ordnance  (area  weapon 
subsystem,  FFAR  rocket,  HMMS  missile). 

(2)  System  Reliability  -  probability  of  0.735  of  completing 
a  one-hour  mission  without  a  system  failure.  A  system 
failure  is  any  fault  in  any  of  the  subsystems  (except 
for  expendable  ordnance)  which  requires  unscheduled 
maintenance.  The  corresponding  system  failure  rate 

and  system  MT3F  are  0.31  and  3-25,  respectively. 


(3)  Flight  Safety  Reliability  -  20,300  hours  mean  time 
between  catastrophic  failures. 

(4)  Maintenance  Manhours  oer  Flight  Hour  -  3.0  to  13.O 
AVUM  plus  AVIM  direct  productive  maintenance  manhours 
(scheduled  plus  unscheduled)  including  all  subsystems. 

(5)  Mean  Time  to  Repair  -  0.90  hours  of  AVUM  plus  AVIM 
on-aircraft  corrective  maintenance  for  all  chargeable 
independent  and  resulting  dependent  failures. 

(6)  Achieved  Availability  -  0.88  based  on  a  utilization 
rate  of  110  hours  per  month. 

In  addition,  RAM  objectives  have  been  established  for  the 
area  weapon  system  and  the  TADS  and  PNVS  systems  which  will 
not  be  listed  here. 

Flight  test  data  have  been  collected  under  the  Army's 
RAM/LOG  Data  System  (described  in  Section  I  of  this  chapter) 
during  the  competitive  fly-off  in  1976  and  throughout  the 
Phase  2  program.  fhe  RAM/LOG  data  derived  from  published 
sources  and  furnished  IDA  by  TSARCOM  are  summarized  in  Table 
20.  The  data  from  the  three  time  periods  given  in  the  Table 
are  taken  from  references  [49],  [50],  and  [51],  respectively. 
Notable  omissions  from  Table  20  are  mission  reliability  data 
and  achieved  availability  data  from  the  1976  time  period.  The 
former  data  have  not  been  collected  to  date  since  it  is  felt 
that  the  profiles  being  flown  are  not  representative  of  AAH-type 
missions.  Achieved  availability  was  not  measured  during  GCT 
because  maintenance  procedures  were  not  fully  developed  at  the 
time,  nor  were  the  aircraft  sufficiently  configured  as  attack 
helicopters  to  provide  useful  data  [^9] .  Also  not  included 
in  the  Table  are  data  from  approximately  3^0  contractor  test 
flight  hours  [52]  flown  prior  to  the  1976  competitive  fly-off. 
With  the  exception  of  mean  time  to  repair,  the  data  are  sum¬ 
marized  in  cumulative  form.  We  were  not  able  to  obtain  the 
data  which  comprise  MTTR — unscheduled  maintenance  event  counts 
and  clock  times  for  those  events — to  enable  reconstruction  of 
the  cumulative  MTTR  trend  over  the  three  time  periods. 
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To  allow  comparison  with  other  helicopter  development 
programs,  the  cumulative  YAH-64  system  failure  rate  is  plotted 
on  a  log-log  grid  in  Figure  30  below.  The  computed  Duane 
growth  rate  is  0.094-  However,  it  has  been  pointed  out  by  the 
AAH  program  office,  the  TSARCOM  Directorate  for  Product  Assur¬ 
ance,  and  the  Army  Materiel  Systems  Analysis  Activity  that  the 
YAH-64  has  undergone  a  large  number  of  system  modifications  to 
date  and  caution  should  be  exercised  in  extrapolating  beyond 
the  time  periods  over  which  the  data  were  collected.  Also,  as 
discussed  in  Section  I  of  this  chapter,  if  the  fact  that  the 
contractor  initially  flew  the  prototypes  for  3^0  hours  were 
incorporated  into  the  data  plotted  in  the  Figure,  the  computed 
growth  rate  would  be  somewhat  larger. 


Figure  30.  CUMULATIVE  SYSTEM  FAILURE  RATE  TREND  OVER  TIME 
FOR  THE  YAH- 64  ADVANCED  ATTACK  HELICOPTER 
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Subject  to  the  above  caveat  regarding  the  Table  20  data, 
it  can  be  seen  that  (a)  MMH/FH  has  improved  and  lies  well  below 
the  program  goal,  ( b )  mean  time  to  repair  has  not  shown  notice¬ 
able  improvement,  and  (c)  achieved  availability  has  improved 
considerably . 


Section  IV 


RAM  Costs  for  the  Army  Utility  Tactical  Transport  Aircraft 
System  (UTTAS)  and  the  Advanced  Attack  Helicopter  (AAH) 

The  Army  Utility  Tactical  Transport  Aircraft  System  (UTTAS) 
and  the  Advanced  Attack  Helicopter  (AAH)  are  the  two  most  recent 
completely  new  helicopters  developed  by  the  U.S.  military  ser¬ 
vices.  RAM  was  emphasized  from  the  beginning  in  both  programs. 

It  is  very  difficult  to  determine  the  true  cost  of  RAM  in 
these  programs.  If  one  defines  RAM  as  a  recent  innovation  in 
aircraft  development  designed  to  improve  R&M  characteristics 
above  some  basic  level,  then  the  costs  involved  are  relatively 
small.  However,  if  RAM  is  defined  as  including  qualification 
of  basic  airworthiness,  then  the  costs  are  a  large  portion  of 
total  development  costs. 

A.  RESTRICTED  DEFINITION  OF  RAM 

If  we  restrict  the  definition  of  RAM  to  the  effort  required 
to  improve  R&M  characteristics  above  some  basic  level,  the  iden¬ 
tifiable  contractor  costs  will  be  largely  those  of  the  Product 
Assurance  Group  and  subsystem  and  flight  tests  including  sub¬ 
sequent  failure  mode  analysis  over  and  above  that  required  for 
Mil  Spec  qualification  for  airworthiness. 

In  the  early  1970s  the  engineering  departments  expanded 
their  organizations  to  include  product  assurance  technical 
specialists  who  wrote  detail  specifications,  test  requirements, 
and  failure  mode  analysis  procedures  related  to  R&M.  They  also 
signed  off  drawings  for  compliance  with  R&M  specs  to  assure 
meeting  " of f-the-board"  reliability  goals. 
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The  organization  for  product  assurance  varied  considerably 
among  manufacturers,  and  hence  cost  comparisons  are  difficult 
to  obtain  for  identical  tasks  related  to  the  R&M  activity. 

From  discussions  with  contractor  personnel  it  appears  that 
during  the  UTTAS  and  AAH  development  programs,  the  manufac¬ 
turers  organized  their  RAM  efforts  as  follows: 

Boeing  Vertol  -  Product  Assurance  reports  to  Engineering 
and  includes  reliability,  maintainability,  safety  engi¬ 
neering,  human  factors,  and  survivability. 

Sikorsky  -  Reliability  and  Maintainability  as  a  group 
reports  to  Systems  Engineering  (also  called  Attributes 
Group)  which  includes  other  engineering  technical  dis¬ 
ciplines  . 

Bell  -  Reliability  and  Maintainability,  Safety,  and 
Human  Factors  were  separate  groups  in  Engineering.  A 
Product  Assurance  group  reported  to  Manufacturing  for 
the  job  of  assuring  currency  of  engineering  changes. 

Hughes  -  Reliability  and  Maintainability  reported  to 
Engineering.  Safety  and  Human  Factors  groups  reported 
directly  to  the  Program  Manager. 

The  Product  Assurance  groups,  like  other  technical  dis¬ 
ciplines,  are  involved  in  the  engineering  design  trade-off 
cycle  in  which  the  optimization  process  considers  all  the 
requirements.  Accordingly,  there  is  a  cost  impact  over  and 
above  the  costs  of  the  product  assurance  engineers. 

The  direct  costs  of  the  Product  Assurance  groups  in  the 
four  recent  Army  helicopter  development  programs  are  shown  in 
Table  21.  The  additional  costs  imposed  on  other  contractor 
activities  by  the  Product  Assurance  Groups  cannot  be  obtained 
from  any  current  accounting  system.  They  can  only  be  esti¬ 
mated  by  a  costly  audit  of  contractor  records  augmented  by 
judgment.  Our  rough  judgmental  estimate  is  that  they  could 
double  or  triple  the  direct  costs  indicated  in  Table  21.  In 
the  Table  it  is  indicated  that  direct  RAM  costs  (Product 
Assurance  group  costs)  range  from  about  one  to  three  percent 
of  .total  contractor  costs.  If  we  include  the  other  contractor 


Table  21.  UTTAS  AND  AAH  PRODUCT  ASSURANCE  AND  TOTAL 
CONTRACTOR  COSTS 

(Thousand  Dollars) 


UTTAS 

AAH 

b 

S i kors  ky 
YUH-60A 

■USnEfli 

Bel  1 
YAH-63A 

Hughes 

YAH-64A 

Phase  I 

Product  Assurance 
(R&M  only) 

1 ,859° 

3,306 

1  ,210 

1  ,303 

Total 

86,900 

117,000 

75,554 

97,865 

Phase  II 

Product  Assurance 

623d 

- 

6,275 

Total 

62,300 

- 

- 

373,919 

Sources: 

a.  Boeing  Vertol. 

b.  AAH  Project  Manager's  Office. 

c.  Sikorsky  Program  Manager  (8  engineers  for  3.5  years). 

d.  Tony  Tornatore,  TSARCOM,  Memorandum,  "Black  Hawk  Contract  Cost  Data," 
no  date.  RAM  program  cost  estimated  at  one  percent  of  total  contract 
cost. 

costs  discussed  above,  total  RAM  costs  would  probably  fall  some 
where  in  the  range  of  two  to  nine  percent  of  total  contractor 
costs. 

Note  in  Table  21  that  Boeing  Vertol  spent  much  more  in  the 
UTTAS  Phase  I  competition  on  Product  Assurance  than  Sikorsky. 
Table  22  indicates  that  the  R&M  results  achieved  by  the  com¬ 
peting  aircraft  were  very  similar.  This  would  indicate  that 
the  higher  expenditures  by  Boeing  Vertol  were  not  effective. 
However,  the  accounting  system  definitions  may  have  been  dif¬ 
ferent.  Further,  the  YUH-61A  was  Boeing  Vertol* s  first  single 
rotor  helicopter  development  and  may  have  required  extra 
resources  to  attain  competitive  R&M  characteristics  with  the 
Sikorsky  YUH-60A  because  of  Sikorsky's  much  greater  experience 
in  single  rotor  helicopter  development. 

Ill 


Table  22.  SIKORSKY  VERSUS  BOEING  VERTOL  RAM  VALUES 
DURING  DT/OT  II 


U7TAS  Proqram 

FI i ght 
Hours 

System 

Failure  Rate 

Mission 

Reliability 

AVuM/AVrM 
Correcti ve 
MMH/ FH 

MTTR 

MTBM 

Achi eved 
Avai lability 

8oe l ng/ Ver  to  1 

0T  1  I 

304.9 

.  391 

.9614 

2.156 

.650 

.476 

.942 

0T  I  I 

259.5 

239 

.9809 

.  864 

.473 

.  784 

.963 

Comb i ned 

564.4 

.  321 

.9703 

1.562 

.592 

.581 

,9i2 

Sikorsky 

0T  I  I 

298.9 

.  388 

.  94  79 

1.189 

.607 

.566 

.954 

OT  I  I 

254.  3 

.287 

.9728 

.945 

.  582 

.831 

.958 

Comb i ned 

553.2 

.  342 

.9592 

1  .077 

.  598 

.663 

.956 

Sources:  [41]  and  [53], 


In  addition  to  the  contractor  costs  discussed  above, 
there  are  Army  costs  involved  in  setting  up  and  administering 
the  RAM  program.  Each  Program  Manager's  Office  has  a  Product 
Assurance  and  Test  Management  Division.  Further,  the  Army 
maintains  extensive  R&M  data  reporting  systems  to  support  the 
RIM  improvement  program.  RAM/LOG  ( Reliability ,  Availability, 
Maintainability/Logistics)  is  the  RO  data  system  used  during 
the  aircraft  test  phase.  Dedicated  personnel  collect  very 
detailed  R&M  data  on  all  aircraft.  Cnee  an  aircraft  is  fielded, 
RAM/LOG  is  replaced  by  3DC  (Sample  Data  Collection).  Detailed 
(but  less  extensive  than  RAM/LOG)  data  are  collected  on  a 
selected  sample  of  aircraft.  Maintenance  personnel  fill  out 
modified  TAMMS  forms.  An  on-site  dedicated  field  monitor 
completes  the  operational  information  and  is  responsible  for 
the  correctness  of  the  maintenance  data.  CRIM  (Component 
Record  for  Intensive  Management)  tracks  individual  components 
(by  serial  number)  of  all  production  aircraft.  This  system 
was  set  up  primarily  for  warranty  administration,  but  was 
subsequently  used  on  non-warranty  components  as  well.  Approxi¬ 
mately  170  components  on  each  aircraft  are  tracked  by  TRIM, 


which  records  ail  removal,  repair, 


installation  events. 


and 


We  have  not  been  able  to  quantify  the  substantial  costs  to  the 
Army  of  these  reporting  systems  which  involve  a  number  of  per¬ 
sonnel  to  record,  computer  process,  and  analyze  large  quanti¬ 
ties  of  data. 

B.  EXPANDED  DEFINITION  OF  RAM 

If  we  expand  the  definition  of  RAM  to  include  development 
and  qualification  of  basic  airworthiness  (a  safety  requirement), 
we  can  identify  much  larger  costs.  Activities  involved  in  this 
process,  in  addition  to  those  of  the  "Restricted  Definition  of 
RAM”  discussed  above,  would  include  the  materials  and  process 
laboratory,  subsystem  tests,  static  test  vehicle,  ground  test 
vehicle,  and  structural  flight  test  vehicle.  In  addition  to 
the  costs  of  the  different  units  of  test  equipment  themselves, 
there  would  be  the  costs  of  conducting  qualification  testing 
and  the  associated  "break  and  fix"  cycle  involved  in  correcting 
deficiencies.  The  costs  of  these  activities  make  up  a  large 
part  of  the  total  development  cost  of  a  helicopter. 


Section  V 


Comparison  of  CH-47C  and  CH-47D  Reliability 

The  Army  is  planning  to  modernize  all  of  its  CH-47A, 
CH-473  and  CH-47C  helicopters  to  CH-47Ds.  The  CH-47D  will 
have  uprated  engines  and  transmissions,  a  new  APU,  an  advanced 
flight  control  system,  fiberglass  rotor  blades,  and  a  number 
of  other  improvements .  The  first  CH-47D,  converted  from  an 
A-model,  began  flight  testing  in  May  1979  [54]. 

The  D  model  will  have  essentially  the  same  performance 
characteristics  as  the  C  model  (15,000  pounds  payload/4,000 
feet/95°F) ;  performance  of  the  A  and  B  models  will  be  upgraded 
to  that  level.  Two  of  the  major  modifications — the  fiberglass 
rotor  blades  and  the  T55-L-712  engines — were  approved  as  PIPs 
to  the  C  model  and  would  continue  even  if  the  D  program  were 
cancelled.  In  addition  to  the  performance  improvement,  the 
goals  of  the  program  are  to  extend  the  life  of  the  fleet; 
improve  RAM,  vulnerability/survivability ,  and  safety;  and  pro¬ 
vide  enhanced  terrain  and  night  flying  capability. 

During  the  period  April  1978  to  December  1979,  three 
CH-47Cs  were  flown  for  a  total  of  2,137  hours.  During  this 
period  reliability  data  were  collected  under  the  RAM/LOG 
reporting  system  to  establish  a  data  baseline  for  comparison 
with  the  CH-47D.  The  CH-47D  was  flown  for  342  hours  in  DT  II 
and  125  hours  in  OT  II.  The  OT  II  was  flown  side-by-side  with 
the  CH-47C,  which  flew  123  hours  in  OT  II. 

The  cumulative  results  of  these  flight  programs  as  of 
August  1930  (2,250  hours  for  the  CH-47C  and  467  hours  for  the 
7H-47D)  are  shown  in  Table  23. 
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Table  23.  COMPARISON  OF  CH-47C  AND  CH-47D  FAILURE 
RATES  PER  THOUSAND  FLIGHT  HOURS 


— 

Subsys  tem 

Hardware  System 

Rel iab  i  1 i ty 
Failure  Rate 

System  Operational 
Reliability 

Failure  Rate 

CH-47C 

CH-47D 

CH-47C 

CH-47D 

Ai r frame 

61 

49 

31 1 

315  . 

Comm/Na v 

38 

45 

46 

60 

Dri  ve 

36 

34 

64 

68 

El ectri cal 

19 

15 

97 

58 

Equi pment 

46 

21 

103 

79 

Flight  Controls 

30 

26 

61 

68 

Hydraul i cs 

21 

4 

54 

15 

Indi cati ng 

44 

32 

76 

43 

Landing  Gear 

14 

26 

26 

34 

Power  Plant 

99 

26 

283 

88 

(Engine) 

(40) 

(6) 

(87) 

(6) 

Rotor 

71 

41 

100 

75 

T  otal 

479 

319 

1,220 

903 

A  Hardware  System  Reliability  (HSR)  failure  is  any  fault 
in  any  equipment  that  results  in  the  inability  of  the  item  to 
perform  its  required  function  and  requires  unscheduled  removal 
of  that  item.  The  unscheduled  removal  rate  is  used  to  deter¬ 
mine  HSR  including  only  Primary  and  Independent  Failures.  HSR 
is  a  measure  of  the  spares  support  requirement  for  the  aircraft. 
A  System  Operational  Reliability  (SOR)  failure  is  one  which 
results  in  the  inability  of  any  component  to  satisfactorily 
perform  its  function  within  specifications  and  requires  unsched¬ 
uled  maintenance  for  correction.  The  total  malfunction  rate 
is  used  to  determine  SOR  including  all  Primary  and  Non-Primary 
and  Independent  and  Dependent  Failures.  SOR  is  a  measure  of 
the  total  unscheduled  maintenance  requirements  of  the  aircraft. 
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Table  23  indicates  that  the  rate  of  occurrence  of  both 
types  of  failures  is  significantly  less  for  the  CH-47D  than 
for  the  CH-47C.  However,  it  should  be  noted  that  the  failure 
rates  for  some  of  the  subsystems  are  higher  in  the  CH-47 D 
than  in  the  CH-47C. 

Using  RAM/LOG  data  provided  by  the  CH-47D  program  office 
as  of  152  flight  hours  together  with  the  data  as  of  467  flight 
hours  given  in  Table  23  above,  reliability  growth  trends  for 
the  CH-47D  can  be  computed,  as  shown  in  Table  24.  While  no 
growth  can  be  observed  for  Hardware  System  Reliability,  it 
should  be  noted  that  the  cumulative  rates  cited  above  are 
already  better  than  the  mature  program  goal  of  .333  failures 
per  flight  hour.  The  growth  rate  of  0.136  for  System  Opera¬ 
tional  Reliability  is  consistent  with  growth  rates  of  other 
helicopter  development  programs  discussed  in  this  paper.  Using 
this  growth  rate  and  extrapolating  back  to  the  100  flight  hour 
point  yields  a  cumulative  System  Operational  failure  rate  of 
1.11.  The  corresponding  cumulative  MTBF  of  0.90  hours  is  64 
percent  of  the  mature  program  goal  of  1.4  hours  MTBF,  quite  a 
high  percent  at  100  flight  hours  relative  to  other  programs. 

Table  24.  RELIABILITY  GROWTH  TRENDS  FOR  THE  CH-47D 


Cumulative  Failure  Rates 

Parameter 

152  Fliqht  Hours 

467  Fliqht  Hours 

Growth  Rate  (a) 

Hardware  System 
Reliability 

0.316 

0.319 

0 

System  Operational 
Re  1  i  ab  i  1  i  ty 

1 .050 

0.903 

0.14 

Section  VI 


CH-53E  Reliability  and  Maintainability  Characteristics 

The  three-engine  Sikorsky  CH-53E  has  been  developed  from 
the  two-engine  CH-53D.  Changes  to  increase  performance  include 
installation  of  a  new  seven-blade  main  rotor  of  increased  diam¬ 
eter,  with  blades  of  titanium/fiberglass  construction,  a  canted 
tail  with  increased  diameter  rotor,  and  an  uprated  transmission 
of  13,190  shp  capacity  [59].  A  General  Accounting  Office  study 
[55]  concluded  that  planned  parts  commonality  has  been  reduced 
to  the  point  where  the  CH-53E  more  nearly  resembles  a  new  air¬ 
craft  rather  than  a  growth  version  of  the  CH-53D. 

Under  Phase  I  of  the  program,  two  YCH-53Es  were  built. 

First  flight  was  1  March  1979.  One  of  these  aircraft  was  lost 
in  an  accident  in  1979.  Phase  II  covered  the  construction  of 
a  static  test  vehicle  and  two  production  prototypes,  the  first 
of  which  flew  on  8  December  1975.  In  February  1978,  Sikorsky 
was  awarded  a  contract  to  begin  full-scale  production,  with 
initial  approval  for  six  aircraft  [5*0  •  First  flight  of  the 
first  production  aircraft  was  in  December  1980. 

Figure  31,  reproduced  directly  from  a  Sikorsky  report  [56] , 
shows  cumulative  and  instantaneous  abort  rates  versus  cumulative 
flight  hours  for  the  two  production  prototype  helicopters.  Note 
that  these  data  fit  the  Duane  model  quite  well.  The  trend  shows 
a  cumulative  abort  rate  at  500  flight  hours  of  0.0805,  a  Duane 
slope  of  0.23  and  a  derived  current  instantaneous  abort  rate  of 
0.0620.  The  trend  reflects  data  for  the  total  aircraft  exclud¬ 
ing  GFE  and  the  prototype  expanded  automatic  flight  control 
system  ( AFC3 ) . 


Table  25  presents  instantaneous  mission  reliability, 
system  reliability,  and  maintenance  manhours  per  flight  hour 
versus  calendar  time  and  cumulative  flight  hours.  All  three 
of  these  R&M  measures  showed  considerable  improvement  over  the 
period  reported.  The  mission  reliability  figures  of  Table  25 
are  somewhat  lower  than  those  implied  by  the  abort  rates  of 
Figure  31  because  Table  25  includes  the  AFCS  whereas  Figure  31 
does  not . 

Table  25.  CH-53E  OBSERVED  RELIABILITY  AND  MAINTAINABILITY 
CHARACTERISTICS  (with  GFE  and  Expanded  AFCS) 


Date 

■ 

Mission 

Rel iabil i ty 
(1  hour) 

System 

Reliability 

(MFHBF) 

Maintenance 
Manhours 
per  Fliqht  Hour 

30  Apr  76 

0.89 

0.62 

19.47 

30  May  76 

0.89 

0.62 

19.47 

26  Jun  76 

0.90 

0.62 

19.45 

30  Aug  76 

0.90 

0.62 

19.45 

13  Jun  77 

0.92 

0.65 

14.75 

9  May  79 

1,412 

0.96 

0.84 

14.20 

Source:  Sikorsky  Report  SER-13242,  Revisions  0  through  4. 


The  values  in  the  table  are  point  estimates  (instantaneous 
values)  computed  over  flight  hour  intervals  ending  at  the  dates 
given  in  the  table.  For  example,  the  mission  reliability  of 
0.96  reported  for  9  May  1979  is  based  on  four  mission  aborts 
occurring  during  the  101  flight  hours  between  cumulative  flight 
hour  1311  and  cumulative  flight  hour  1412.  Converting  the  mis¬ 
sion  reliability  values  in  the  table  to  instantaneous  mission 
abort  rates  and  computing  a  mission  reliability  growth  rate 
yields  a  value  of  a  =  0.79.  The  system  reliability  growth  rate 
as  computed  from  Table  25  is  a  =  0.22.  The  mission  Reliability 
growth  rate  is  extremely  high  relative  to  other  helicopter 
development  programs.  The  system  reliability  growth  rate  is 


121 


also  relatively  high.  Using  the  system  reliability  growth  rate 
to  extrapolate  a  starting  (100  flight  hour)  cumulative  MPHBF 
yields  a  value  of  0.28  MFHBF,  30  percent  of  the  mature  program 
goal  of  0.92.  The  reasons  the  data  in  Table  25  deviate  from 
the  expected  Duane  slope  values  are  as  follows: 

(1)  Duane  slope  calculations  assume  that  changes  are  incor¬ 
porated  throughout  the  development  program  as  problems 
are  encountered  and  solved.  In  the  case  of  the  '"’H-53E, 
the  changes  were  incorporated  in  a  block  toward  the  end 
of  the  development  program,  which  resulted  in  sharp 
increases  in  the  Duane  slopes  for  Mission  Reliability 
and  System  Reliability  toward  the  end  of  the  program. 

(2)  Calculation  of  the  Duane  slope  requires  that  the  fail¬ 
ure  data  be  cumulative  as  well  as  the  flight  hours. 

The  failure  data  used  to  derive  the  Mission  and  System 
Reliabilities  were  computed  over  flight  hour  intervals 
ending  at  the  dates  in  Table  25  corresponding  to  the 
cumulative  flight  hours.  This  resulted  in  the  Duane 
slopes  showing  higher  growth  (because  the  earlier  fail¬ 
ure  rate  data  were  excluded)  than  was  actually  the  case. 

The  conclusion  to  be  drawn  is  that  when  block  changes  are 
incorporated  into  a  helicopter,  including  design  oriented  ( non- 
R&M)  improvements,  the  reliability  growth  data  do  not  corre¬ 
spond  closely  to  the  Duane  curve  formulation. 
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Section  VII 


Cost  and  Time  Required  to  "Grow"  R&M  in  the  Development  P.hase 

Duane  [2]  found  that  for  some  equipments  cumulative  fail¬ 
ure  rate  versus  cumulative  operating  hours  resulted  in  a 
straight  line  when  the  data  points  were  plotted  on  log-log 
paper.  He  expressed  these  ’’Duane  curves"  by  the  equation 

CFR  =  At~a  , 

where 

CFR  =  cumulative  failure  rate 

A  =  initial  failure  rate  (intersection  at  t=l  hour) 
t  =  cumulative  operating  hours 
a  =  exponent . 

-a  denotes  the  slope  of  the  cumulative  failure  rate  line: 
when  a  is  positive,  there  is  a  decreasing  failure  rate;  when 
it  is  negative,  there  is  an  increasing  failure  rate.  If  cumu¬ 
lative  failure  rate  versus  cumulative  operating  hours  falls  on 
a  straight  line  (the  "Duane  curve"),  then  instantaneous  fail¬ 
ure  rate  will  also  fall  on  a  straight  line  with  the  equation: 

IFR  =  ( 1-a) At~a  . 

The  1975  IDA  Study  [1]  included  data  on  R&M  growth  during 
the  development  phases  of  the  AH-56A,  0H-6A,  and  CH-53A  heli¬ 
copters.  For  convenience,  four  figures  from  the  1975  Study 
are  reproduced  here  as  Figures  32  through  35.  Figure  32  shows 
that  the  AH-56A  failure  rate  data  fit  a  Duane  curve  quite  well. 
This  program  was  cancelled  after  1,426  flight  hours  of  develop¬ 
mental  testing.  Figure  33  for  the  0H-6A  covers  both  development 
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and  production  flight  hours .  The  first  approximately  5,000 
flight  hours  were  developmental  and  the  rest  were  production. 

If  we  neglect  the  first  point  at  100  flight  hours,  the  data 
indicate  a  decreasing  failure  rate  that  roughly  follows  a 
Duane  curve  with  a  cumulative  failure  rate  of  about  0.6  at 
100  flight  hours  decreasing  to  about  0.4  at  5,000  flight  hours. 
Figure  34  for  the  CH-53A/D  is  taken  directly  from  a  Sikorsky 
report;  it  was  replotted  in  Figure  35  on  log-log  paper.  The 
developmental  flying  (through  FIP)  roughly  follows  a  Duane 
curve . 


The  CH-53A/D  data  were  for  aborting  failures  while  the 
other  data  were  for  all  failures.  The  growth  rate  for  the 
CH-53A/D  (a=0.4)  was  much  greater  than  for  the  AH-56A  (ct=0.l5) 
or  the  0H-6A  (a=0.10).  (Mote  that  a  =  0.10  for  the  OH-oA  is 
for  the  first  5,000  flight  hours.  The  a  =  0.35  shown  on  Figure 
33  is  determined  by  some  suspiciously  low  failure  rates  after 
10,000  flight  hours.) 


Figures  9  and  10  of  Section  I  indicate  that  the  Black 
Hawk  roughly  followed  a  Duane  curve  during  the  Basic  Engineer¬ 
ing  Development  phase  (if  we  ignore  the  point  at  2.6  flight 
hours).  It  then  departed  sharply  from  a  Duane  curve  as  indi¬ 
cated  in  Figure  9.  Some  possible  reasons  for  this  departure 
are  discussed  in  Section  I.  The  growth  rates  and  cumulative 
failure  rates  at  100  flight  hours  for  the  three  programs  for 
which  we  have  failure  rates  for  all  failures  are: 


AH  —  o  o  A 
CH-oA 


Cumulative  Failure  Rate 
a  at  100  Flight  Hours 

3.16  1.7 

0.10  0.6 


YTJH-60 A  (3ED)  0.13 

We  have  increased  the  YUH-60A 
Figures  9  and  10  of  Section  I 
flying  that  was  not  included. 


0.7 

failure  rate  from  that  of 
to  account  for  early  contractor 
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The  above  data  indicate  somewhat  erratic  trends  of  fail¬ 
ure  rate  improvement  during  helicopter  development  programs. 
However,  in  at  least  a  very  approximate  way,  the  programs  tend 
to  be  characterized  by  the  Duane  growth  process.  Because  of 
the  mathematical  convenience  of  the  Duane  equation,  let  us 
hypothesize  a  "typical"  helicopter  development  program  char¬ 
acterized  by  a  =  0.13  and  a  cumulative  failure  rate  at  100 
flight  hours  =  0.7.  These  two  values  permit  us  to  calculate 
A  =  1.274.  The  cumulative  and  instantaneous  failure  rates 
for  the  "typical"  helicopter  are  shown  in  Figure  36.  Note  that 
the  basic  characteristic  of  the  Duane  curves  is  that  the  fail¬ 
ure  rate  is  reduced  by  the  same  proportion  for  each  order  of 
magnitude  increase  in  cumulative  flight  hours.  In  the  case 
of  Figure  36,  the  failure  rate  at  100  flight  hours  is  about 
74  percent  of  that  at  10  flight  hours;  at  1,000  flight  hours 
it  is  74  percent  of  that  at  100  flight  hours,  etc.  The  nature 
of  the  relationship  becomes  much  more  dramatic  visually  when 
the  instantaneous  failure  rate  is  replotted  on  a  linear  grid 
(see  Figure  37).  On  Figure  37  we  have  added  a  dashed  line 
(a=0.4)  representing  the  fastest  rate  of  improvement  we  are 
aware  of  for  any  helicopter  development  program  (the  CH-53 
abort  rate).  For  comparison  with  the  "typical"  helicopter 
(a=0.l3),  we  have  assumed  the  same  cumulative  failure  rate  at 
100  flight  hours  of  0.7. 

The  failure  rate  is  driven  down  during  the  development 
phase  by  a  continuous  cycle  of  "fail  and  fix"  consisting  of 
the  following  basic  steps: 

1.  Test  hours  accumulated: 
a.  bench  test 

(1)  transmission  test  stand 

(2)  rotor  blade  fatigue  tests 

(3)  flight  control  fatigue  tests 

(4)  miscellaneous  component  fatigue  tests 

(5)  failure  data  collected 
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b.  rotor  whirl  tower  test 

c.  ground  test  vehicle 

d.  flight  test. 

2.  Failures  analyzed: 

a.  failure  mode  identified 

(1)  design  deficiency 

(2)  quality  control 

(3)  unanticipated  environmental  conditions 

b.  corrective  action  established. 

3-  Hedesign/rework  to  eliminate  cause  of  failure. 

4.  Test  redesigned/reworked  component  to  verify  adequacy 
of  corrective  action. 

5.  Replace  old  part  by  new  part  in  the  system  (test 
aircraft,  spares,  etc.). 

The  cost  of  this  R&M  growth  process  during  the  helicopter 
development  phase  (Basic  Engineering  Development)  is  associated 
with  bench  tests,  whirl  tests,  and  ground  test  vehicles  since 
the  flight  test  vehicles  are  almost  totally  committed  to  veri¬ 
fication  of  basic  qualification  specification  requirements. 
However,  the  flight  test  vehicles  accumulate  a  significant 
amount  of  time  in  the  operating  environment  and  are  an  impor¬ 
tant  contribution  to  the  R&M  growth  process  during  this  phase 
of  the  development  program.  This  could  also  be  true  of  the 
maturity  phase  where  design  changes  require  requalification 
and  R&M  growth  results  from  the  same  test,  analyze,  and  redesign/ 
rework  process. 

Later  in  the  helicopter  life  cycle,  it  has  been  industry 
practice  to  eliminate  the  ground  test  vehicle  (for  cost  reasons) 
but  maintain  the  bench  test  facilities.  Qualification  of  prod¬ 
uct  improvement  programs  is  usually  accomplished  by  a  combina¬ 
tion  of  bench  tests  by  the  contractor  and  accelerated  service 
flight  tests — generally  at  military  test  centers  where  this 
testing  can  be  combined  with  other  flight  tests  such  as  avionics 
functional  tests,  pilot  training,  etc. 
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As  can  be  seen,  the  reliability  growth  process  involves 
many  interrelated  elements.  The  conventional  way  of  analyzing 
changes  in  helicopter  R&M  characteristics  over  time  is  to 
plot  their  values  as  a  function  of  cumulative  flight  hours 
(see  Figures  32-36).  When  using  such  data,  one  must  realize 
that  the  flying  per  se  is  only  one  element  in  the  R&M  growth 
process.  For  example,  the  mix  of  bench,  whirl,  GTV,  and  Con¬ 
tractor  and  Army  flight  teets  used  in  the  Black  Hawk  develop¬ 
ment  phase  is  presented  in  Figure  33  taken  directly  from  a 
Sikorsky  report. 

We  were  not  able  to  estimate  the  associated  dollar  expen¬ 
ditures  for  R&M  improvement  because  current  cost  accounting 
systems  do  not  clearly  separate  expenditures  for  R&M  improve¬ 
ment  from  expenditures  for  the  many  other  aspects  of  helicopter 
development  and  production  programs. 

There  is  a  schedule  time  involved  in  accomplishing  R&M 
improvement  programs  such  as  those  depicted  in  Figure  37. 

Figure  39  shows  the  rate  of  accumulation  of  developmental 
flight  hours  versus  years  for  several  helicopter  programs. 

The  AH-56A,  0H-6A  and  CH-53A  data  were  developed  from  informa¬ 
tion  in  the  1975  IDA  Study  [1]  .  Figure  39  indicates  that  the 
0H-6A  program  accumulated  more  developmental  hours  more  rapidly 
than  the  other  programs.  The  0H-6A  was  a  much  smaller  aircraft 
and  thus  the  cost  of  accumulating  hours  was  much  less.  Ten 
GH-6A  prorotypes  were  built  (versus  three  Army  and  one  contractor 
for  the  Black  Hawk) .  Programs  similar  to  the  AH-5oA  and  Black 
Hawk  programs  would  require  about  seven  years  to  accumulate 
3,000  flight  hours;  the  0H-6A  type  program  would  accumulate 
10,000  flight  hours  in  five  to  six  years.  As  discussed  above, 
the  accumulation  of  flight  hours  is  only  one  element  in  the 
R&M  growth  process;  nevertheless,  the  above  data  on  time 
required  to  accumulate  flight  hours  indicate  that  extensive 
R&M  growth  programs  could  take  years  to  accomplish.  The  cost 


132 


/ 

/ 

/ 


YEARS 


Figure  39.  HELICOPTER  DEVELOPMENT  FLIGHT 
HOURS  VERSUS  CALENDAR  TIME 

and  time  required  for  such  programs  may  be  justified  by  the 
necessity  for  achieving  the  R&M  program  goals  which  would 
result  in  improved  operational  capability  and  reduction  in 
ownership  costs  in  service  use. 

The  Duane  equation  indicates  that  failure  rate  as  a  given 
number  of  flight  hours  is  a  function  of  both  initial  failure 
rate  (A)  and  the  rate  of  improvement  (a).  Figure  40  shows 
for  various  a's  the  cumulative  MTBF  at  100  flight  hours,  in 
percent  of  mature  program  goal,  required  to  achieve  the  mature 
program  goal.  A  program  is  generally  considered  to  have 
reached  maturity  after  20,000  to  100,000  flight  hours,  and 
Figure  40  shows  the  relationships  for  both  values.  For  example, 
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Figure  40.  CUMULATIVE  SYSTEM  MEAN  TIME  BETWEEN  FAILURES  (MTBF)  AT  100  HOURS 
VERSUS  GROWTH  RATE  REQUIRED  TO  ACHIEVE  MATURE  PROGRAM  GOALS 


if  failure  rate  improves  at  the  rate  a  =  0.2,  the  goal  at 
100,000  flight  hours  will  be  achieved  if  the  cumulative  MTBF 
at  100  flight  hours  is  20  percent  of  the  mature  program  goal. 

On  Figure  40  are  plotted  the  values  for  the  following 
helicopters  for  which  goals  were  established  and  for  which 
we  were  able  to  obtain  Duane  curves: 


Mature 

Program 

MTBF  Goal 

Cumulative 
System  MTBF 
at  100  Hours 

Growth 

Rate 

(a) 

AH- 56 A 

10.60 

0.59 

0.16 

UH-60A 

4.00 

1.40 

0.13 

YAH- 6 4 

3.25 

0.87 

0.09 

CH-53E 

0.92 

0.28 

0.22 

CH-47D 

1.40 

0.90 

0.14 

Note  that  most  of  the  a's  lie  in  the  0.1  to  0.2  range.  If  that 
rate  of  growth  can  be  maintained  to  20,000  or  100,000  flight 
hours,  then  the  cumulative  MTBF  at  100  flight  hours  must  be 
approximately  one-third  of  the  mature  goal  in  order  for  the 
helicopter  to  meet  its  mature  program  goal. 

The  UH-60A,  CH-47D  and  CH-53E  all  appear  to  be  capable  of 
meeting  their  mature  program  goals.  The  two  major  modification 
programs  (the  CH-47D  and  CH-53E)  appear  much  more  likely  to  meet 
their  failure  rate  objectives  than  the  completely  new  helicopter 
programs.  The  AH-56A  was  unlikely  to  meet  its  mature  program 
goal  (which  was  much  more  ambitious  than  those  of  the  other  pro¬ 
grams).  Since  its  cumulative  MTBF  at  100  hours  was  only  5.6 
percent  of  its  mature  goal,  its  a  would  have  had  to  increase 
from  0.16  to  approximately  0.4  in  order  to  achieve  its  mature 
goal.  In  fact,  the  AH-56A  program  was  terminated  after  1,426 
flight  hours  of  developmental  testing.  The  AH-64  may  have 
difficulty  In  meeting  its  goal;  its  a  will  have  to  increase 
from  the  0.09  experienced  to  date  to  approximately  0.17  in 
order  to  meet  its  goal  by  100,000  flight  hours. 
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Chapter  III 

PRODUCTION  PHASE  R&M  DATA 


Section  I 


Navy  3-M  Data 


Navy  aircraft  maintenance  data  are  reported  under  the 
Maintenance  Material  Management  (3-M)  reporting  system,  a 
computerized  system  operated  by  the  Navy  Main'  .nance  . Support 
Office,  Mechanicsburg,  Pennsylvania.  Data  are  submitted  on 
all  Navy  aircraft  in  service  use;  the  test  period  prior  to 
service  use  is  not  covered.  Data  are  available  on  a  monthly 
basis.  The  Navy  advised  against  our  use  of  its  3-M  data 
before  CY  1968  because  of  reliability  problems  prior  to  that 
time . 

Data  are  assembled  by  major  operating  command — for 
example,  the  UH-1N  reports  show  separate  data  for  the  follow¬ 
ing  operating  commands: 

FMFLANT  (Fleet  Marine  Force  Atlantic) 

CNAP  (Commander,  Naval  Air  Force  Pacific) 

MARNFMF  (Marine  Non-FMF) 

NATRA  (Naval  Air  Training) 

CNAL  (Commander,  Naval  Air  Force  Atlantic). 

Data  for  helicopters  operating  under  combat  conditions  in 
Vietnam  probably  are  not  representative  of  normal  noncombat 
operations.  Accordingly,  we  excluded  data  from  the  Pacific 
commands  in  our  use  of  the  3-M  data. 
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The  3-M  system  permits  the  ready  calculation  of  three  R&M 
measures:  (1)  mean  flight  hours  between  maintenance1  actions 
(MFH3MA);2  (2)  mean  flight  hours  between  failures1  (MTBF);  and 
(3)  maintenance1  manhours  per  flight  hour  (MMH/FH).3  It  is 
also  possible,  with  great  effort,  to  obtain  mission  abort  rates; 
however,  in  cur  use  of  the  3-M  data  we  developed  only  the  first 
three  R&M  measures. 

The  3-M  data  are  coded  by  numerical  work  unit  codes  (WUCs) 
which  identify  the  various  parts  of  the  helicopter;  this  coding 
permits  one  to  assemble  data  by  helicopter  system.  We  assembled 
data  into  the  following  systems:  (1)  airframe,  (2)  rotors  and 
hubs,  (3)  gear  boxes  and  drives,  (4)  power  plant,  (5)  instru¬ 
ments,  communication,  and  navigation,  (6)  weapon  systems  (where 
applicable),  and  (7)  total.  In  many  cases  the  weapon  systems 
are  responsible  for  relatively  few  maintenance  actions,  fail¬ 
ures,  and  maintenance  manhours;  in  those  cases  the  data  for  the 
weapon  systems  shown  in  the  tables  are  not  plotted  on  the  graphs. 
3-M  data  are  available  for  five  basic  types  of  Navy  helicopters: 
the  H-l ,  H-2 ,  H-3,  H-46,  and  H-53. 

Our  1975  study  presented  3-M  data  for  1968  through  1973  [1] • 
For  the  present  study  we  obtained  3-M  data  for  the  period  January 
1973  through  June  1979-  In  comparing  the  new  1973  figures  with 
those  in  our  earlier  study,  we  found  slight  differences.  The 
new  quantities  (of  flight  hours,  failures,  etc.)  in  many  cases 
were  higher,  indicating  that  all  of  the  1973  data  had  not  been 
entered  in  the  3-M  data  files  which  we  obtained  for  our  earlier 


Reference  [1]  includes  the  following  definitions: 

Maintenance.  All  actions  necessary  for  retaining  an  item  in  or 
restoring  it  to  a  specified  condition. 

Failure.  The  inability  of  an  item  to  perform  within  previously 
specified  limits. 

2 Unscheduled  maintenance  actions  only. 

3Unscheduled  maintenance  only  at  the  organizational  and  the  intermediate 
maintenance-activity  levels. 
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study.  For  that  reason,  we  have  replaced  the  old  1973  figures 
in  both  tables  and  graphs  with  the  new  figures,  and  we  have 
not  plotted  the  data  for  the  first  half  of  1979  on  the  figures. 
In  the  tables  below  we  have  not  repeated  the  data  for  1968 
through  1972  which  were  included  in  our  1975  study. 


1 •  The  H-1 

In  Table  26  we  have  combined  the  data  for  all  the  single¬ 
engine  types  in  this  series  except  the  AH-1G  gunship  (i.e., 
the  UH-1D ,  UH-1E ,  UH-1H,  UH-1L,  TH-1L ,  and  HH-1K  models). 

Since  all  models  in  Table  26  are  quite  similar,  we  feel  that 
a  more  meaningful  fleet  average  is  obtained  by  combining  these 
types  rather  than  by  considering  them  individually.  Tables 
27  through  29  present  data  for  three  other  H-1  models  in  Navy 
service:  the  UH-1N,  AH-1G ,  and  AH-1J.  The  UH-1N  and  AH-1J 

are  twin-engine  models.  These  three  are  sufficiently  different 
(from  the  H-1  models  of  Table  26)  and  we  felt  they  should  be 
treated  separately.  Using  the  data  of  Tables  26  through  29, 
the  three  R&M  measures  are  plotted  for  the  various  H-1  models 
in  Figures  41  through  52.  For  all  H-1  models,  the  three  R8cM 
measures  worsened  markedly  over  the  years  these  helicopters 
have  been  in  service.1 

The  trends  for  the  various  components  do  not  appear  to 
differ  systematically  from  the  trends  for  the  total  aircraft. 
The  RScM  characteristics  in  the  most  recent  years  of  the 
UH-l/HH-l/TH-1  series,  the  UH-1N,  and  the  AH-1G  were  all  about 
the  same.  However,  the  AH-1J  was  markedly  worse  than  the  other 
models.  The  AH-1G  deliveries  began  in  1967,  while  the  first 
AH-1J  deliveries  were  in  1970  [57].  Surprisingly,  the  AH-1J, 
which  was  based  on  the  AH-1G,  exhibited  R&M  characteristics 
that  were  about  twice  as  bad  as  those  of  the  AH-1G. 


‘In  some  cases  'when  a  helicopter  was  entering  service  and  the  data  for 
these  years  were  not  meaningful,  they  were  not  plotted. 
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Table  26.  NAVY  3-M  DATA  FOR  UH-1D,  UH-1E,  UH-1H, 
UH-1L,  TH-1L,  AND  HH-lK  MODELS 


flight  -aint 

YEAR  HOURS  ACTIONS  “FHBMA  FAIw.  MTSF  xAN-HRS  xh/FH 


AIRFRAME 

197  3 

-51e5 

983, 

-  .  61 

*127 

3.32 

3b25o 

.3  2 

1971 

-72,3 

11125 

3.31 

73  27 

o.  :2 

*1  b 16 

.38 

197* 

••3  5  59 

15375 

3.1b 

'257 

■3  .  o9 

5«/99b 

1.25 

197o 

37333 

15398 

2.38 

7631 

3379b 

1  ■  *  2 

1977 

-339e 

16e  3  2 

2.13 

3172 

*..91 

39  o  *  J 

1.17 

1979 

35293 

197o3 

1.79 

7389 

o^319 

1.91 

1979 

153-io 

9-3  7 

2.32 

2367 

5.25 

2 1  j6B 

1.-3 

ROTORS  AND 
1973 

HUBS  (*AIN 
4  5  lb  5 

'TAIL  J 
*257 

11.13 

2139 

18.75 

19645 

.•il 

1971 

47243 

5n34 

3.39 

2932 

16.29 

17982 

.38 

1975 

-8559 

0  Jl  7 

9.37 

2921 

16 .  ol 

233  3  3 

.*.8 

197o 

37933 

b  3So 

5.95 

3211 

11.79 

;jo7i 

.55 

1977 

*  J  J98 

b*  3  1 

o.21 

3  235 

1^.-2 

21*2*. 

.*54 

1978 

33233 

1  i  .* 

-  .  *0 

3397 

11.39 

2  72  2  * 

.  77 

1979 

1524o 

2399 

*.17 

1121 

13.-2 

11125 

.  /  4 

3EAR  30XES 
1973 

ANO  OR 
-Slo5 

IVES 

io  J  2 

23.19 

989 

-5 . 0  7 

'-91 

.17 

1971 

.7213 

27o7 

1'.37 

1129 

33.36 

13395 

.22 

1975 

-3559 

29o  9 

1 0 . 3o 

1137 

3.3.'? 

952' 

.23 

197o 

378  33 

357o 

13.58 

1532 

25.19 

12711 

.31 

1977 

13398 

3319 

13.13 

1277 

31. .3 

12.15 

.31 

1978 

35283 

293  2 

12.33 

1339 

26.35 

l.o93 

.12 

1979 

15310 

12  2' 

1 2 . 2o 

529 

23.  •- 

3  5  21 

.  3  9 

ROWER  PLANT 
1973 

15165 

3257 

13.87 

2171 

23.  '9 

12376 

.29 

1971 

17213 

lb-5 

13.17 

2677 

17.  ol 

15-99 

.33 

197* 

18559 

.672 

13.39 

2532 

19. -1 

'C5t: 

.32 

1976 

37833 

-396 

3.61 

2361 

16.22 

23171 

.  '  J 

1977 

13398 

1715 

3.53 

2811 

11.25 

23988 

.  0  2 

1978 

35283 

6429 

5.19 

321e 

13.97 

*29*7 

1.2: 

1979 

15316 

2226 

6 . 7b 

1233 

12.23 

11153 

.96 

INSTRUMENTS 

.COMMUNICA 

TION 

AND  NAVIGATION 

1973 

18165 

5219 

3.65 

3318 

11.82 

25287 

.56 

1971 

17213 

5873 

3.35 

3137 

13.37 

23123 

.19 

1975 

-8559 

7663 

6.31 

1195 

11.58 

.  8  3  0  — 

.58 

1976 

37833 

7338 

5.18 

1131 

A.  39 

2357  1 

.  7b 

1977 

-  3  3  98 

7321 

5.71 

-133 

9.77 

33137 

.75 

1978 

35233 

'277 

1.35 

3861 

9.13 

31739 

.98 

1979 

15  >lo 

2961 

5.38 

1515 

9.93 

12813 

.35 

WEAPON  SYSTEMS 

1973  -51e5 

19 

2377.11 

7 

6152.11 

— 

.  22 

1971 

,7113 

1 2 

‘  936.92 

11813.7* 

2b 

.  22 

1975 

18559 

:  j 

-358 . 93 

e 

9711.83 

D  3 

.22 

1970 

378  33 

19 

1991.21 

7 

8131.71 

-1 

.  J2 

1977 

*  J  298 

lo5 

2  *  3  «  J  2 

bl 

0*7.31 

993 

.22 

1978 

35233 

219 

ibi.ii 

93 

379.39 

1182 

.33 

1979 

153-6 

123 

123.37 

a 

341.95 

*29 

•  2  4 

••♦TO 

1971 

7  A  • 

*5165 

•  • 

23953 

1.39 

11351 

3.21 

1 w  Jb  2  9 

2^ 

23 

1974 

17213 

3335  3 

1.-3 

17446 

2  ,  7  1 

1 2  8  b  *  1 

2  • 

3  J 

1975 

43559 

3b"  2b 

1.  32 

19723 

2 .  b  5 

12*938 

2 . 

b  3 

197o 

37933 

3755  3 

1. 21 

1938b 

1.99 

::??9* 

■j 

19 

l  3 

-3398 

2  3  Jb  3 

1.35 

1  ?bo  2 

2 .  „  * 

1^32“ 

*  „ 

1973 

35  233 

**  3bo 

.32 

17990 

1 .  ?b 

iaoi  ui 

»  4 

3b 

19**? 

1 5  J  *0 

1  s  1  2  5 

.  39 

'  3  2  0 

2.2b 

->  5  2  5  m. 

•  • 

33 
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Table  27.  NAVY  3-M  DATA  FOR  MODEL  UH-1N 


YEAR 

FLIGHT 

HOURS 

ACTIONS 

MFHBMA 

fail. 

“T3F 

MAINT 

MAN-HRS 

MH/FH 

AIRFRAME 

1973 

15793 

425o 

3.71 

2251 

0.72 

i;377 

.91 

197; 

15638 

;z;9 

3.67 

23;' 

o .  o5 

13679 

.38 

1975 

1653b 

d533 

2.5, 

3113 

,.35 

21553 

1.33 

1976 

16385 

33  5; 

1 . 9e 

;133 

3.9' 

27;39 

1.67 

1977 

17671 

9735 

1.82 

,795 

3 .  o9 

31836 

1.83 

1978 

19339 

915, 

1.97 

,  «  '  t 

3.78 

;;?2e 

2.;s 

1979 

7888 

392; 

2.31 

2235 

3.53 

19635 

2.;9 

ROTORS  AND 
1973 

HUBS  {MAIN/TAIL 
15793  1433 

11.3; 

545 

28.97 

;i3; 

.26 

197; 

1 5o  38 

1228 

12.71 

552 

28.28 

3ee6 

•  2, 

1975 

165  3b 

285  ; 

5. "9 

398 

13. ,1 

8;93 

C  1 

197b 

16385 

2496 

6.56 

1381 

15.1b 

9528 

.58 

1977 

17671 

2631 

6.79 

1173 

15.13 

12631 

.71 

1978 

18333 

233; 

9.33 

915 

19.7a 

12315 

.  o7 

1979 

7888 

5„ 

i;.53 

333 

20.33 

2551 

.32 

GEAR  BOXES 
1973 

AND  DR 
15793 

IVES 

o7S 

23.39 

,  1  s 

37. 78 

29oo 

1  Q 

197; 

15o38 

719 

21.71 

361 

,3.24 

3 1 ;  5 

.23 

1975 

1653b 

11,2 

i;.,8 

;55 

3b  .  3, 

;;;9 

.  2 ' 

197o 

16385 

1173 

13.97 

568 

28.85 

5  ;  5 1 

.33 

1977 

17671 

1391 

12.73 

ell 

28.92 

7873 

.;s 

1978 

18333 

1513 

11.92 

733 

25.76 

11855 

.  6e 

1979 

"’888 

,;9 

17.57 

225 

35.36 

1676 

.21 

POWER  PuAN 
1973 

15793 

236; 

6.68 

i;83 

13.65 

15382 

.97 

197; 

15638 

1982 

7.37 

12;2 

12.57 

le;37 

1.35 

1975 

16536 

265; 

6.23 

173; 

9.73 

lb565 

1.33 

1976 

16385 

3559 

;.63 

2356 

0.95 

23329 

1  •  ,  2 

1977 

17671 

3631 

;.9i 

2293 

7.72 

22;67 

1.27 

1978 

133  33 

3,35 

5.33 

2179 

8.27 

2o236 

1  •  ,  0 

1979 

*988 

l;;; 

5.;b 

953 

3.28 

l;339 

1.78 

INSTRUMENTS , COMMUNICATION 
1973  15793  2892 

AND  NAVIGATION 
5.46  1428 

11.36 

13737 

.68 

197; 

15638 

2613 

5.98 

i;Se 

13.72 

13339 

.  6  , 

1975 

165  3b 

2919 

5.06 

1612 

13.26 

11586 

.73 

1976 

16385 

3579 

;.58 

1999 

3.23 

16614 

1.31 

1977 

17671 

38  76 

;  .  5b 

19;3 

9.11 

16398 

.91 

1978 

18333 

;  28  3 

;.2i 

1867 

9 .  o6 

22722 

1.2b 

1979 

7888 

1662 

;.7s 

313 

9.o4 

9o41 

1.22 

WEAPON  SYS 
1973 

TEMS 

15793 

13 

1579.33 

3917.53 

9 

.33 

197; 

15638 

12 

1333.67 

C 

3121.63 

a 

.33 

1975 

16536 

9 

1837.33 

2 

3268.33 

12 

.33 

1976 

16385 

9 

1823.56 

c 

3277.33 

11 

.33 

1977 

17671 

9 

1963.44 

, 

,;17.75 

11 

.33 

1978 

18333 

13 

1933.33 

, 

; 5  37 . 53 

ie 

.33 

1979 

'988 

3 

2629.33 

c 

3944.32 

c 

.33 

•••TO 

1973 

7  &  M  * 

15^93 

•  * 

He2  7 

1.36 

o  22  9 

2.53 

;7635 

3.31 

197; 

15638 

138  33 

i.;s 

5  963 

2 .  o2 

4o9b  5 

3.31 

1975 

16536 

16131 

1.33 

938, 

2.35 

62655 

3  .  *9 

19*6 

ie  385 

19173 

.  95 

13139 

1.62 

82372 

‘5.33 

197- 

1*671 

21193 

.  3  3 

13813 

1 .  o3 

9391e 

5.1, 

19^9 

18  3  3  3 

23  3  o  9 

.89 

.  3  ,  J 

\  *  *5 

117572 

0.52 

19*9 

-age 

3  32o 

.  38 

,53o 

,7^8* 

0.32 

1^1 


Table  28.  NAVY  3-M  DATA  FOR  MODEL  AH- 1 G 


YEAR 

FLIGHT 

HOURS 

ACTIONS 

*FH8MA 

FAIL. 

MT3F 

MAIN? 

NAN**HRS 

*H/FH 

AIRFRAME 

L9T3 

13b: 

337 

2.32 

333 

^  •  J9 

1765 

1.33 

19'4 

129b 

531 

2.62 

286 

4.38 

1611 

1.15 

1975 

1237 

3J8 

1.59 

437 

2.35 

2611 

2.2  3 

1976 

1472 

*32 

1.33 

366 

J2 

3272 

2.22 

1977 

2691 

1224 

2.23 

o94 

3.38 

493o 

1.32 

1979 

3b  1 

371 

.97 

192 

1.38 

1467 

4  •  J6 

1979 

J 

4 

J.  J3 

2 

J.  JJ 

6 

J.  JJ 

ROTORS  ANO 
1973 

HUBS ( *A IN /TAIL j 
1362  95 

14  .  j4 

61 

22.33 

411 

.  J  J 

197, 

129b 

174 

3.32 

66 

21.15 

586 

•  4  2 

1975 

1287 

172 

7.48 

99 

14.33 

1147 

.39 

1976 

1^72 

259 

5.63 

122 

12.37 

1717 

1.17 

197’ 

2b91 

38-. 

7.  J1 

224 

12.31 

2963 

1.13 

19*8 

561 

95 

3.52 

7 

" .  63 

.49 

1.24 

1979 

J 

J.22 

2 

j.22 

3 

J  .  J  3 

3EAR  30X35 

AND  DRIVES 

1973 

12  o2 

*2 

18.92 

.9 

27.33 

21b 

.  io 

1974 

1 39b 

77 

18.13 

53 

27.92 

344 

.25 

1975 

1237 

173 

7., 4 

US 

12.26 

7  0 1 

.59 

1 97o 

14*2 

136 

7.91 

31 

19.17 

1J19 

.69 

1977 

2b  9 1 

249 

ij.ai 

122 

22 . 36 

1491 

.55 

1979 

3t>l 

51 

7. 38 

2  4 

15.34 

273 

.  76 

1979 

u 

1 

J  •  J  J 

J 

J  •  2  J 

3.23 

POWER  PwANT 

1  ?  7  3 

!3oZ 

;:- 

6.28 

133 

12.24 

518 

.38 

1974 

139b 

149 

9.37 

33 

16.32 

599 

.43 

1975 

1237 

239 

4.45 

153 

3.15 

938 

.73 

197b 

1472 

249 

5.91 

126 

11.68 

1518 

1.33 

1977 

2691 

339 

9.71 

138 

14.31 

1233 

.  46 

1978 

5ox 

114 

3.17 

58 

6.22 

427 

1.18 

1979 

J 

7 

3.33 

J  •  J  J 

17 

3.33 

INSTRUMENTS , CCM*UNI 
1973  13b2 

CATION 

315 

ANO  NAVIGATION 
4.32  122 

11.16 

1263 

.78 

1974 

1396 

328 

4.26 

125 

11.17 

362 

.  0  2 

1975 

1297 

268 

4.83 

127 

13.13 

1557 

1.21 

1976 

1472 

362 

4.29 

158 

9.32 

1633 

1.39 

1977 

2691 

638 

3.91 

355 

*.58 

3835 

1.41 

1978 

361 

lei 

2.24 

66 

5  .  .  7 

1266 

2.95 

1979 

J 

y 

a.  JJ 

3.22 

3.23 

WEAPON  SYST 
1973 

'SMS 

1262 

b3 

21.62 

1  - 

3  J  •  12 

177 

.13 

1974 

139b 

24 

58.17 

3 

174.59 

c  ^ 

.  J  4 

1375 

1*37 

44 

29.25 

12 

127.25 

32 

.  Jb 

1976 

14  72 

*9 

13.63 

35 

1  a*  Jb 

385 

.26 

1977 

Ib9  1 

193 

14.16 

99 

29.93 

2153 

.39 

1978 

3bl 

25 

'4  i  ■’ 

U 

3b .  1  j 

93 

.2d 

1979 

J 

e 

J.  JJ 

: 

J.JJ 

IS 

J.  J9 

•  *  *  7  j 

1973 

?  *  •  * 

1 2b2 

•  * 

1343 

1.31 

- 1  c 

1.99 

4153 

3.  JS 

1974 

1296 

1233 

1.39 

*13 

2.2b 

-35e 

2.91 

1975 

1237 

1754 

.73 

929 

1.29 

'  J96 

!  .51 

197o 

.4-6 

.31' 

.  '7 

3R9 

1 . 30 

951, 

3  .  >80 

197" 

Zb9  1 

134. 

.38 

1  n  7  * 

l.bl 

16  558 

3.1! 

l  3T3 

In  1 

31“ 

.  4. 

19" 

.91 

• - c 

I..  rO 

1  ?“  9 

- 

22 

3 . 3  j 

1 2 

-.22 

,0 

„ .  „  2 

J 
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Tab!  e 

29  . 

NAVY 

3-M 

DATA 

FOR  MODEL  AH-1J 

YEAR 

LIGHT 

HOURS 

ACTIONS 

MFHBMA 

FAIm. 

"T3F 

"AINT 

"AN-HRS 

MH/FH 

AIRFRAME 

1973 

o5  24 

9  =  o9 

1.93 

2939 

2 .  o  7 

12321 

1.39 

1979 

=  3  7b 

33  =  3 

1.62 

1923 

:.3j 

11932 

2.12 

197  = 

7b- J 

=  3  =  6 

1.93 

2812 

2.71 

1.193 

1.3=  1 

197b 

sioa 

.789 

1.38 

2659 

1.99 

13823 

2.  o3 

1977 

6  J98 

7133 

,  86 

39  =  3 

1.54 

19331 

3.13 

1978 

9935 

53o8 

.38 

2993 

1.51 

17557 

3.9o 

1979 

ms 

112b 

.99 

o  34 

1.35 

o  Jb5 

5.99 

ROTORS  AND 
1973 

HUBS (MAIN/TAIL i 
o524  914 

7.19 

411 

15 .37 

,367 

.67 

1979 

=  376 

*81 

6 . 38 

.13 

13.32 

,2  48 

.75 

1975 

'642 

115  9 

o.  =  9 

=  25 

14.55 

.291 

•  56 

197b 

5 1 5  2 

967 

3.39 

,12 

12.59 

,56  2 

.38 

1977 

o  3  98 

iiii 

5.98 

51b 

11.33 

.173 

.  08 

1979 

,,35 

513 

5.48 

34  J 

13.  J. 

3434 

1979 

111' 

2  J3 

=  ..9 

97 

11  .,9 

o  78 

•  o  1 

3 EAR  30XES 
1973 

AND  DRIVES 

5  5  24  "7  28 

9.21 

.32 

15.13 

33  43 

.59 

197; 

5375 

461 

1 1 .  ob 

269 

19.99 

2  J4o 

.38 

1975 

7  6  ,  2 

-9b 

9  •  6  J 

3  o3 

2 J  .  “b 

3J3o 

.  .3 

1970 

5162 

32j 

b .  3  J 

.33 

12.31 

=  36  3 

.38 

1977 

b288 

926 

0.57 

.17 

1 ,  ■  o  2 

,225 

.  o9 

1978 

9935 

o  53 

0.79 

319 

13.93 

5375 

1.21 

1979 

1115 

14b 

7 .  o4 

3b 

12.97 

93  = 

.39 

POWER  PLANT  1 

1973 

6524 

21  o  7 

3.31 

1329 

..93 

13253 

1.57 

1979 

=  376 

1935 

2.32 

1397 

3.39 

12389 

2.33 

197  = 

“b  4  J 

2239 

3,42 

136  a 

5.58 

3  =  99 

1.12 

197o 

=  162 

io9  3 

3.35 

1392 

..95 

o3  7  7 

1.33 

1977 

6388 

2297 

2.71 

1330 

9.50 

11762 

1.93 

1978 

99  3  5 

1737 

2.5  = 

1192 

3.38 

12  =  93 

2.39 

1979 

111' 

352 

3.17 

217 

5.19 

2159 

1.93 

INSTRUMENTS 

1973 

, COMMUNICATION  AMO  NAVIGATION 
0=29  2218  2.99  1359 

6.19 

6462 

.99 

1979 

5376 

1*37 

3.57 

321 

6.55 

7228 

1.39 

197  = 

?84J 

2393 

3.65 

983 

7.  77 

o285 

.32 

1970 

5 1  o  2 

1599 

3.23 

3b2 

o  •  J  3 

3212 

1.59 

1977 

6  2813 

2112 

2.38 

1339 

b.  J3 

13389 

1.66 

1978 

,435 

1532 

2.33 

“41 

5.99 

3887 

2.22 

1979 

1115 

322 

3  .  ,6 

1'3 

6.56 

13=7 

1.-7 

WEAPON  SYSTEMS 

1973  952; 

1J37 

6.2'.' 

461 

14.15 

2991 

•  ,0 

i  1979 

5376 

731 

7.67 

399 

15.93 

3271 

.  Oi 

1975 

64  J 

369 

-.38 

,  ,  ( 

17.39 

=  23  9 

.  o  9 

1976 

516  2 

932 

5.59 

.93 

11.  o5 

6613 

1.23 

1977 

b288 

995 

0.12 

,  o  4 

13.12 

5734 

.39 

1978 

.935 

'17 

6.19 

269' 

1 6  •  ,  9 

3737 

.39 

1979 

1115 

224 

9.98 

'9 

14.11 

1313 

1.17 

•**70? 

1973 

Am* 
5  5  24 

*  * 

11613 

.56 

0121 

1.37 

3993  = 

b  •  1 2 

1974 

5  3  7b 

3735 

.  62 

5122 

1.35 

93389 

-  .  g  i 

1975 

“642 

12637 

.61 

0533 

1.17 

9158  = 

i.i. 

1?75  . 

51o2 

128  22 

.43 

5317 

.39 

951=3 

3.-  = 

197- 

3289 

14491 

.  ,  2 

-092 

.  “9 

55  23b 

? .  28 

:?~3 

,,  3  c 

1  2  5  b  7 

.  4  2 

=  -51 

, 

51332 

1 1 .  o  3 

1  9“  ? 

•  *  ’  C 

23  ’  i 

.  ,  ' 

1253 

.39 

12999 

11.30 

14 
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,fAK  BOXI-J  AND  DRIVf>i\. 


MTBF  VERSUS  YEAR  FOR  THE  NAVY  UH-1N 


70, 


The  H - 2 


2  . 

The  U.S.  Navy  is  the  only  operator  of  the  H-2.  A  total 
of  190  were  built  —  each  with  a  single  T-5S  engine.  Eighty- 
eight  were  UH-2A  aircraft  and  102  were  UH-2B  aircraft,  which 
differed  only  in  the  noninstallation  of  certain  electronic 
navigation  equipment.  Starting  in  1967,  the  survivors  of 
these  190  aircraft  were  all  converted  to  twin  T-58  engines 
and  were  redesignated  as  the  UH-2C,  HH-2C,  HH-2D,  SH-2D,  and 
3H-2F.  We  first  segregated  the  3-M  data  for  the  H-2's  into 
three  groups:  (1)  the  UH-2A  and  UH-23;  (2)  the  UH-2C ,  HH-2C , 
and  HH-2D;  and  (3)  the  SH-2D  and  SH-2F.  However,  the  three  R&M 
measures  for  these  three  groups  were  all  quite  similar  in 
total  and  by  component ,  both  in  levels  of  R&M  and  in  trends 
over  time.  Accordingly,  in  Table  30  and  Figures  53  through 
55,  we  have  aggregated  data  for  all  the  H-2  aircraft.  Figures 
53  through  55  indicate  that  the  three  R&M  measures  have  all 
worsened  somewhat  over  time.  The  trends  for  the  various  com¬ 
ponents  do  not  appear  to  differ  systematically  from  the  trends 
for  the  total  aircraft. 

Compared  with  the  other  Navy  helicopter  types,  the  H-2 
R&M  characteristics  are  poor,  particularly  relative  to  the 
H-l  aircraft,  which  are  approximately  the  same  size.  There 
are  probably  several  causes  contributing  to  this  result: 

•  The  H-2  generally  has  been  operated  in  detach¬ 
ments  of  one  or  a  few  aircraft.  Economies  of 
scale  thus  have  been  lacking  in  their  operating 
environment . 

•  Fewer  H-2  aircraft  than  any  of  the  other  types 
were  built.  Accordingly,  the  economic  incen¬ 
tives  to  introduce  product  improvements  have 
not  been  as  great  as  for  the  other  types. 

•  Insofar  as  years  of  experience  and  production 
quantities  are  concerned,  Kaman  is  somewhat 
behind  the  other  manufacturers. 
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Table  30 . 

NAVY 

3-M  DATA  FOR 

ALL 

H-2  MODELS 

“LIGHT 
YEAR  HOURS 

ACTIONS 

MFH8MA  “AIL. 

HTBF 

*a:nt 

*AN-HRS  MH/FH 

AIRFRAME 

1973 

1218' 

1,383 

.32 

7535 

1.62 

37818 

3.39 

1974 

11353 

17383 

.65 

7713 

1.43 

43327 

3.62 

197' 

u;73 

17141 

.61 

3189 

1.2S 

91893 

4.33 

197b 

l ;  6  3; 

13893 

•  77 

9387 

l.al 

53324 

3.62 

1977 

13;  7i 

13564 

.13 

7943 

1.79 

59927 

4.45 

1978 

1299; 

215b  1 

.58 

3189 

1.53 

63288 

4.33 

1979 

9998 

3995 

.56 

3831 

1.33 

2578  3 

5.16 

ROTORS  AND 
1973 

HUBS  (MAIN/TAILi 
1213'  993' 

&  .  ,  3 

2893 

4.21 

174*9 

1.43 

197; 

11353 

432b 

2.7' 

2131 

5.19 

135a; 

1.23 

197' 

13973 

3133 

3.34 

1637 

6.52 

13349 

.99 

197a 

Ua39 

3936 

4.26 

178  3 

8.21 

11983 

.32 

1977 

13971 

3515 

3.33 

le89 

7.98 

13554 

1.31 

1979 

12999 

4563 

2.74 

2191 

5.72 

13719 

1.'3 

1979 

999e 

2333 

2*  ,6 

1333 

4.3' 

3894 

1.78 

SEAR  30XES 
1973 

AND  drives 

12185  2232 

5.53 

1255 

9.71 

3849 

.31 

197; 

1135  3 

2717 

,.37 

1247 

9.3tf 

13339 

.93 

197' 

13973 

2788 

3.“b 

1239 

3.88 

13233 

.97 

197a 

I9b39 

3331 

,.39 

1521 

9.o2 

13315 

.39 

1977 

13971 

3394 

4.35 

1416 

9.51 

14173 

1.35 

1978 

12999 

3365 

9.38 

1525 

3.19 

1537a 

1.21 

1979 

9998 

1143 

,.37 

587 

3.51 

,132 

.a2 

ROWER  ?  l. ANT 

197  3 

12185 

4211 

2.39 

2385 

5.11 

10317 

1.31 

197; 

11353 

4732 

2.34 

2359 

4.89 

16113 

1*46 

197' 

13973 

9433 

2.38 

2176 

4.81 

19356 

1.37 

197a 

14634 

514a 

2.39 

2313 

8.39 

21563 

1.47 

1977 

13971 

4381 

3.37 

1823 

7.43 

16577 

1.23 

1978 

12994 

4278 

2.92 

2333 

6.25 

19333 

1.52 

1979 

,998 

1958 

3.43 

688 

7.26 

7233 

1.44 

INSTRUMENTS .communication 
1973  1218*  '298 

and  navigation 
2.32  2629 

4.63 

17687 

1.45 

197; 

11353 

4778 

2.31 

2286 

9.39 

13885 

1.69 

197* 

13473 

4754 

2.23 

2148 

9.98 

23981 

2.33 

197b 

14834 

5233 

2.31 

2286 

8  .  .3 

25321 

1.71 

1977 

13471 

4933 

2.73 

2136 

5.31 

23397 

1.74 

197a 

12494 

;  6  j  8 

2.69 

2131 

5.36 

22579 

1.31 

1979 

9998 

2163 

2.51 

3*5 

5.23 

9543 

1.91 

WEAPON  SYSTEMS 

1973  12188 

219 

55.64 

119 

136.39 

733 

.36 

197; 

11353 

363 

33.95 

159 

89.52 

933 

.38 

197' 

13473 

61' 

17.33 

278 

37.87 

1989 

.19 

1978 

14634 

813 

23.37 

269 

55.43 

2332 

.19 

1977 

13471 

577 

23.35 

229 

58,33 

1b96 

.13 

1978 

12994 

839 

23.69 

239 

59.78 

1593 

.13 

1979 

4399 

332 

16.55 

139 

45.35 

592 

.12 

:973  12185 

*  « 

3166' 

.38 

16811 

■  72 

99333 

3.1' 

197; 

IUS3 

33897 

.33 

15895 

.72 

99815 

9.31 

1975 

U«73 

32831 

.52 

_  15632 

.87 

99898 

9.52 

1376 

14634 

38819 

.  43 

17251 

.35 

126835 

3.65 

137" 

13471 

35364 

.53 

15233 

.  3R 

129324 

3 .  o3 

153 
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Figure  54.  MTBF  yERSUS  YEAR  FOR  ALL  NAVY  H-2  MODELS 


3. 


The  H-3 


Most  H-3  aircraft  in  Navy  service  over  the  1968-1978  time 
period  were  SH-3  aircraft  (antisubmarine-warfare  helicopters) — 
mainly  SH-3A,  SH-3D,  SH-3G,  and  SH-3H  aircraft.  Table  31  pre¬ 
sents  3-M  data  for  all  H-3  models;  the  three  R&M  measures  are 
plotted  in  Figures  56  through  58.  Relative  to  1968,  all  three 
measures  improved  markedly  in  1969,  but  after  1969  they  wors¬ 
ened  fairly  steadily  over  time,  until  they  were  considerably 
worse  in  1973  than  they  were  in  1968.  The  trends  for  the 
various  components  do  not  appear  to  differ  systematically  from 
the  trends  for  the  total  aircraft. 
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Table  31.  NAVY  3-M  DATA  FOR  ALL  H-3  MODELS 


*£AR 

flight 

HOURS 

ACTIONS 

FA  10. 

NTBF 

MAINT 
MAN -HRS 

MH/FH 

AIRFRAME 

1973 

3 

3  bo  3o 

1.  lb 

19713 

1.15 

95132 

2.15 

137, 

43*15 

**3  A.  A. 

1.33 

13,1b 

1.13 

111373 

1.53 

197J 

16129 

iO'  Jv 

.99 

11511 

4  •  *  - 

139373 

3.31 

L97S 

17133 

51113 

.31 

13115 

1.3, 

113913 

3.18 

1977 

17517 

35391 

.3b 

13891 

1.39 

135679 

3.13 

1978 

,S61o 

51099 

•  71 

Ib793 

1.73 

Ib33b3 

3.57 

1979 

13137 

13391 

.73 

1 1 4  ’  4 

1.53 

31599 

3.56 

ROTORS  AND 
1973 

HUBS  (MAIN/ 
,21o3 

’TAIL) 

0  j  24 

6.71 

3213 

13.37 

2517b 

.63 

1971 

,3115 

0^12 

b.29 

3311 

13.13 

2911b 

.67 

197« 

la  129 

7989 

5.77 

3387 

11.37 

31111 

.75 

197b 

,7133 

*498 

3.32 

3  9b  2 

11.92 

36632 

.79 

1977 

,75,7 

33-4 

S.7J 

,2  22 

11.32 

37816 

•  33 

1973 

,ia,o 

3  3  5  3 

•  •  —  0 

37~8 

11. .3 

33222 

.'3 

1979 

15137 

35  lo 

5  .  lo 

1713 

13.38 

13853 

.  7b 

ZZAR  9CXSS  *NC  CR 
L97  3  -Z-o3 

-  4 

1  2  •  9t> 

j 

23.99 

23171 

.,8 

1 9  ■  4  n-nI: 

}  2o8 

7  1  -  a 

1  o  7  5 

25.92 

23131 

•  -  > 

L  3  7  5  -» 0  i.  2  9 

3-o3 

13.33 

13«* 

25,53 

22393 

.,8 

19'b  ,'139 

3,3. 

13.,? 

1929 

-  e  ^  -7 

2227? 

•  *  • 

1977  .75,7 

.399 

11.03 

2  Jb  3 

23.35 

23318 

.  oi 

197?  ,3blo 

-oil 

9.98 

444. 

•  a  -  a 

4b237 

.53 

1379  1913' 

;*3S 

991 

19.33 

'925 

ROWER  90AN7 
1973 

42-0.3 

s3. 

0  •  o9 

3  53- 

3 . 13 

2517* 

.59 

1971 

■*342  5 

.  ,  rt 

0  •  J  7 

3  u  3  1 

-  •  •«  9 

23338 

.  os 

1975 

4oi29 

3  53b 

jc  ;e 

3 .  JS 

3  72bl 

.31 

197, 

■b  71 33 

93b7 

5  •  J3 

3841 

.2*4' 

12331 

.39 

L977 

47547 

931b 

5.1J 

3  0  7  3 

.2  •  ?o 

,335b 

.91 

1978 

4564b 

13381 

*  •  71  3 

3713 

2.28 

53311 

1.13 

1979 

18137 

,213 

4*33 

1442  12.53 

19897 

1.13 

instruments 

,  COMMUNICATION 

AND  NAVIGATION 

1973 

121n3 

16225 

2.52 

7573 

5.61 

51913 

1.29 

1971 

13115 

16896 

2.57 

7157 

5.32 

59311 

1.37 

1975 

16129 

19373 

2.12 

3537 

5.12 

71151 

1.61 

1976 

17138 

19333 

2. 44 

8358 

5.61 

32197 

1.75 

1977 

,7517 

19693 

2.11 

3125 

5 .  a. 

31323 

1.71 

1978 

15616 

19168 

2.38 

31*7 

5.58 

31392 

1.78 

1979 

18137 

'736 

2.31 

3228 

5.62 

32363 

1.77 

weapon  systems 

1973  12663 

1311 

32.32 

573 

71.11 

2885 

.37 

1971 

13115 

1615 

26.39 

513 

79.  J8 

1213 

.13 

1975 

16129 

1338 

25.51 

612 

75.37 

1736 

.13 

1976 

17138 

1383 

25.33 

572 

32.11 

5118 

.11 

1977 

17517 

2322 

16.35 

'15 

66.53 

6819 

.11 

1978 

15616 

3893 

11.73 

1132 

,3.32 

9522 

.21 

1979 

13137 

1629 

11.13 

137 

11 . 1 3 

3535 

.19 

•  *  *  7  0 

1973 

7  A  ,  • 
12363 

•  * 

'3123 

.61 

36117 

1.17 

221117 

« 

.28 

1971 

13115 

77891 

.56 

35532 

1,22 

253392 

5 

.33 

1975 

,6129 

37871 

.53 

39662 

1.16 

312332 

0 

.76 

1976 

17138 

33555 

.53 

11687 

1.13 

338175 

* 

.18 

1977 

,7517 

?96o  3 

•  4  3 

,  2 ' 3  6 

1.11 

363344 

■* 

•  si 

1973 

,S6,o 

128  113 

.  *2 

15926 

.39 

363823 

- 

_  s-T 

197? 

13137 

,1381 

•  4  J 

1  3323 

.31 

:41S8j 

* 

'.h 
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MTBF  VERSUS  YEAR  FOR  THE  NAVY 


TOTAl 


CALENDAR  YEAR 


4.  The  H - 4 6 

Most  H-46  aircraft  in  Navy  service  are  CH-1^  aircraft 
(cargo  helicopters) — mainly  CH-46A,  CH-46D,  and  CH-46F  air¬ 
craft.  Table  32  presents  3-M  data  for  all  H-46  models;  the 
three  R&M  measures  are  plotted  in  Figures  59  through  61.  The 
R4M  measures  show  the  same  general  pattern  as  those  of  the 
H-3  aircraft;  relative  to  1968,  all  three  measures  improved 
markedly  in  1969,  but  after  1969  they  worsened  considerably, 
until  they  were  much  worse  in  1978  than  they  were  in  1968. 

The  trends  for  the  various  components  do  not  appear  to  differ 
systematically  from  the  trends  for  the  total  aircraft. 
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Table  32.  NAVY  3-M  DATA  FOR  ALL  H-46  MODELS 


'{EAR 

FLIGHT 

HOURS 

ACTIONS 

MFHBMA 

FAIL. 

"TSF 

MAINT 

manors 

*H/FH 

AIRFRAME 

1973 

3  b  3  J  7 

28537 

1.27 

!o298 

2.23 

93313 

2.57 

1979 

3787; 

3SJ79 

1.38 

18971 

2.35 

lljejl 

2.32 

1975 

93  3o7 

;38;; 

.92 

210J3 

1.92 

uiu; 

3.53 

1976 

-3379 

,3151 

.93 

23231 

1.39 

15393b 

3.93 

1977 

.9992 

53632 

.3, 

29311 

1.35 

222353 

■4  a  •«  0 

1978 

,3155 

52659 

.33 

27121 

1.55 

198953 

•i  •  72 

1979 

1  78  3  5 

22513 

.37 

13389 

1  •  6 

77763 

■4  *  S6 

ROTORS  AND 
1973 

HUBS  (<*A 
36337 

IN/TAIL  > 
11162 

3.25 

.127 

3.83 

93975 

1.13 

1979 

37879 

12226 

3.12 

.9  27 

3.56 

51619 

1.3b 

1975 

9J3e7 

11313 

3.57 

5395 

7.55 

53321 

1.31 

197o 

9J279 

11281 

3.63 

5192 

7 .7b 

57b3  3 

1 . 1 3 

1977 

,9392 

138  77 

3.23 

n  1 .3 

'.31 

79923 

1.73 

1978 

.2155 

13531 

3.12 

oo39 

o.31 

32872 

1.9^ 

1979 

179  35 

5376 

3.32 

2713 

o.53 

2  981  ' 

1 .  o  "* 

DEAR  BOXES 
1973 

AND  DR 
3b33' 

IVES 

3b8  2 

9.3b 

1 9'  9 

13.35 

23  355 

.  5b 

1979 

378  7, 

3359 

9.83 

223  5 

13.39 

2955b 

.  o  5 

1975 

9  J  36  7 

5217 

3.25 

2535 

lb. 11 

32b  23 

.31 

197b 

9J279 

.832 

3.39 

2319 

17.37 

397,8 

.9° 

197' 

.9892 

5  93  2 

7.61 

27'  ' 

.  b  .  .  2 

.o"3* 

2.2. 

1978 

.2155 

o325 

7.33 

3299 

12.78 

91  b9o 

.99 

1979 

1*835 

2953 

7.28 

2285 

13.38 

1523  5 

.  35 

ROWER  PvANT 
1973 

3b  33  7 

5o97 

b  •  R|  3 

273b 

13.17 

31J73 

.30 

1979 

3  78  79 

o  J  71 

b  •  Z* 

2379 

13.16 

39955 

.  •  w* 

1975 

9  J  36  7 

3969 

>.77 

3b9S 

11.37 

59792 

1.36 

197b 

93279 

3723 

>  •  62 

3b32 

13.95 

56753 

1.91 

1977 

.9892 

9235 

>.9b 

3359 

21.65 

55999 

1.25 

1978 

.2155 

93.1 

> .  bb 

939b 

2  3-29 

57JS5 

1.55 

1979 

17835 

3355 

5.32 

1522 

11.39 

1  9663 

1.12 

instruments 

1973 

,  COMMUNICATION 
3t>327  llo85 

AND  NAVIGATION 

3*11  6  2^  *4 

5.81 

91135 

1.13 

1979 

37879 

12793 

2.97 

6373 

5.51 

96982 

1.23 

1975 

9256  7 

13533 

2.98 

6955 

5.33 

51583 

1.28 

1976 

93  279 

13339 

3.32 

b899 

5.39 

636  29 

1.51 

1977 

9.892 

16298 

2.33 

355  2 

5.25 

75331 

1 .  o7 

1978 

.2185 

16375 

2.62 

3355 

5.J5 

33298 

1.  ’3 

1979 

17835 

6335 

2.52 

339. 

5.33 

32153 

1.33 

WEAPON  SYS' 
1973 

TEms 

36337 

39 

1267.35 

o 

0351,17 

.1 

.23 

1979 

378  79 

37 

1J23.62 

7 

5913.57 

08 

.32 

1975 

93367 

23 

1755. J9 

11 

3669.73 

73 

.22 

1976 

.  J  279 

93 

936.72 

u 

,327.93 

o3 

.32 

1977 

99892 

31 

1998.13 

; 

11223 ,23 

38 

.23 

1978 

92155 

33 

1277.92 

ij 

.215.53 

37 

.22 

1979 

17835 

16 

1119.69 

i 

17835.33 

25 

.32 

*•*70 

1973 

7  A  u  * 
2*32  7 

•  • 

63795 

.0  2 

jl-ilJ 

2.16 

226992 

o .  25 

1979 

2  7874 

73313 

c  ^ 

39661 

1.39 

272771 

'  .12 

1975 

•* 3  367 

32191 

.99 

3  9*46** 

1 . 2  2 

333193 

9.15 

1976 

.32*9 

31131 

.53 

28296 

1.35 

373  289 

3 . 1-* 

197- 

•r  ^  39  2 

38725 

.  ,5 

■43599 

.99 

958 1 2b 

IJ.21 

19*8 

.1155 

?7  jOL 

•  ^  J 

.9365 

.35 

962953 

13.93 

19?9 

1  *93  5 

382.2 

i  - 

.93 

1  ~-4o  3  J 

a  #  -  a 
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CAlENDAR  YEAR 


MTBF  VERSUS  YEAR  FOR  THE  NAVY  H-46 


I 


CALENDAR  YEAR 


5.  The  H- 53 

Most  H-53  aircraft  in  Navy/Marine  service  are  CH-53  A  and 
D  cargo  helicopters ;  the  remaining  H-53s  are  RH-53D  minesweep¬ 
ing  helicopters.  Table  33  presents  3-M  data  for  all  CH-53 
models;  the  three  R&M  measures  are  plotted  in  Figures  62 
through  64.  Table  33  includes  R&M  measures  for  CH-53  weapon 
systems.  However,  since  the  weapon  systems  accounted  for  such 
a  small  portion  of  the  total  R&M  activity,  the  weapon  system 
data  points  in  most  cases  did  not  fall  on  the  R&M  scales  used 
in  Figures  62  through  64  and ' therefore  were  not  plotted  on 
these  figures.  All  three  measures  show  a  generally  worsening 
trend  over  the  1968-1978  period.  Rotors  and  hubs  exhibit 
trends  worse  than  those  of  the  other  components.  The  trends 
for  the  other  components  do  not  appear  to  differ  systematically 
from  the  trends  for  the  total  aircraft. 


Table  33.  NAVY  3-M  DATA  FOR  ALL  H- 53  MOOELS 


YEAR 

HOURS 

ACTIONS 

"FHBMA 

FAt,. 

mtBF 

'-AI  NT 
MAN -HRS 

MH/FH 

a raFRAMS 
1973 

19533 

23799 

ao 

12,2  J 

1.99 

o?213 

3.63 

’.97; 

23773 

4  J8b  3 

i.  jj 

12229 

1 . 7  J 

75339 

3 .  o  1 

1975 

U798 

197,9 

.35 

13853 

1.55 

92993 

5.51 

197o 

137J9 

23  339 

.32 

12262 

1.53 

139519 

5.85 

1977 

239J  7 

2,125 

.37 

13395 

1.5a 

129o, 9 

5.96 

1973 

Uh  1  -i 

31919 

•  7  J 

17731 

1.27 

157319 

7.J1 

1979 

U9i; 

13133 

.33 

7,87 

l*  *iO 

5  9855 

5.98 

ROTORS  AND 
1973 

HUBS  (MAIN /TAIL i 
13SJ3  5 JSo 

3.06 

2889 

s.98 

26357 

1.91 

197W 

2J77J 

5259 

3.95 

3313 

0.39 

26698 

1.29 

1975 

16798 

5917 

2.3, 

28  7, 

5.39 

,1721 

2.98 

19^0 

137j9 

"3  40  3 

2.  99 

2877 

o.5J 

,7216 

2.52 

»  9“*"* 

2  J9j  ' 

*31? 

3.31 

3,3  8 

o.l3 

,'133 

2.25 

;  = 

2  2,1, 

-  ;  3- 

-‘•53 

3  39' 

-  .  o  2 

59323 

2.92 

1  ? 

12  92, 

2  5  5  ; 

,.28 

1 . 0  ' 

-  ^  c 

23387 

1.37 

“  i  -  = 

9“3  i?5«3 

3  3ou 

5.51 

2319 

9 .  lo 

12239 

.no 

9"-.  2  J  “7  J 

32J' 

n  . 

1871 

11.13 

1,119 

.  o3 

9""5 

2*28 

*5  •  ltJ 

1635 

13. ,7 

19566 

.37 

9"o  1?%) 

-  2  ,  . 

n.lc 

1697 

11 .3e 

19951 

1.37 

37  ’  U9<J7 

33  71 

o..n 

1753 

11.95 

23585 

.98 

:2-t  ii 

37JS 

* .  «>5 

2358 

.  13.39 

33662 

1.53 

?~y  i .  ? ; 

13o2 

5 .  J  2 

'31 

13.99 
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Figure  62.  MTBMA  FOR  THE  NAVY 


(UOO!|-ih>!M)  SJamiVJ  NUMUt  3WU  MV3W 
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MTBF  VERSUS  YEAR  FOR  THE  NAVY  H-53 


lViOl 


6. 


General  Trends 


The  time  trends  of  Figures  41  through  64  indicate  that  the 
R&M  measures  for  every  major  component  group  for  every  basic 
Navy  helicopter  type  worsened  from  1968  to  1978.  Unfortunately, 
for  all  five  basic  types  of  helicopters,  the  year  of  introduc¬ 
tion  into  Navy  inventory  was  before  1968.  Hence,  we  cannot 
say  definitely  what  the  trend  in  R&M  measures  is  from  year  of 
first  introduction  into  service.  However,  mishap  rates  from 
the  Naval  Safety  Center  are  available  from  time  of  introduction 
for  all  the  Navy  helicopters  (see  Figure  71  in  Section  III 
below).  The  Naval  Safety  Center  data  show  a  general  worsening 
in  mishap  rates  from  time  of  introduction  into  the  Navy  inven¬ 
tory.  Hence,  it  is  probable  that  the  three  R&M  measures  worsen 
from  time  of  introduction  into  the  inventory.  Evidently,  the 
aging  of  the  fleet  that  occurs  over  time  outweighs  the  benefi¬ 
cial  effects  of  product  improvements  and  results  in  an  overall 
worsening  of  R&M  measures  during  the  service  life  of  the  air¬ 
craft  . 
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Section  II 


U.S.  Air  Force  Reliability  and  Ma i nta i nabi 1 i ty  Data  . 

The  Air  Force  publishes  reliability  and  maintainability 
(R&M)  data  based  on  the  D056  Product  Performance  data  system. 
These  data  are  published  in  reference  [58]  at  the  two-digit 
work  unit  code  level  for  all  USAF  aircraft.  Data  are  pre¬ 
sented  for  six-month  periods  starting  1  April  1972  nd  ending 
31  March  1978. 

The  data  report  numbers  of  maintenance  events  and  corre¬ 
sponding  maintenance  manhours  are  given  for  "inherent," 
"induced,"  and  "no  defect"  maintenance  events.  "Inherent" 
maintenance  events  are  defined  as  "activity  resulting  from 
malfunctions  that  are  coded  as  occurring  internal  to  the 
equipment,"  while  "Induced"  maintenance  events  are  "coded  as 
induced  in  the  equipment  from  external  sources."  "Inherent" 
maintenance  events  should  provide  a  truer  picture  of  trends 
in  the  inherent  R&M  characteristics  of  the  equipment  since 
external  influences  are  removed  insofar  as  possible.  Accord¬ 
ingly,  we  have  extracted  only  "inherent"  maintenance  event 
data. 

Data  for  the  five  helicopter  types  included  in  reference 
[58]  are  summarized  in  Table  3^  and  plotted  in  Figures  65 
through  69.  At  the  end  of  each  trend  line  in  the  figures,  the 
trend  is  characterized  as  "better,"  "worse,"  or  "constant." 
These  characterizations  are  summarized  in  Table  35,  which  indi¬ 
cates  a  majority  of  worsening  trends  for  each  of  the  three  R&M 
measures . 
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Table  34 . 


USA  F  HELICOPTER  RELIABILITY 


AND  MAINTAINABILITY 


DATA 


Innerent 


Hel i  copter  Type 
i  Aeoort  Perioa 

Hying 

Hours 

Maintenance 

Events 

Innerent  Maintenance  MH 

Innerent  Maintenance  MH/FH 

-• 

MTBME 

Organizational 

Organizational 

■rwTJunfiv 

UH-1F 

• 

Apr  72  -  Mar  73 

39,164 

21,761 

1.30 

77,982 

14.158 

1 .99 

0.36 

•• 

Apr  73  -  'Aar  74 

26,543 

14,795 

t .  79 

62,251 

10.094 

2.35 

0.38 

' 

Apr  "4  -  Mar  75 

23,983 

11,458 

2.09 

44,357 

5.790 

1.34 

0.24 

Apr  75  -  Mar  76 

17,833 

26,618 

1.50 

33,944 

3,267 

1.90 

0.18 

' 

Apr  7 6  -  Mar  77 

11,961 

7,906 

1.51 

33,595 

3,160 

2.81 

0.26 

Apr  77  *  Mar  73 

19,279 

9,183 

2.10 

37.253 

4,317 

1.93 

0.22 

UH-1M 

•  ft 

Apr  72  -  Mar  73 

19,636 

8,111 

2.42 

43,028 

6,298 

2.19 

0.32 

Apr  73  -  Mar  74 

17,949 

7,499 

2.39 

39,590 

7.689 

2.20 

0.43 

‘T 

Apr  74  «•  Mar  75 

20,558 

9,107 

2.26 

42,135 

3,624 

2.05 

0.18 

- 

Apr  75  -  Mar  76 

20,221 

11,006 

1.34 

52,871 

4,528 

2.62 

0.24 

Apr  76  -  Mar  77 

13,267 

11,001 

0.83 

63,670 

5,607 

4.30 

0.42 

Apr  77  -  Mar  73 

23,639 

12,014 

1.97 

60,197 

6,464 

2.55 

0.27 

AH-1H 

Apr  72  -  Mar  73 

0 

o 

o 

0 

- 

Apr  73  •  Mar  74 

5,083 

1,576 

3.22 

6,234 

427 

1.23 

0.08 

Apr  74  -  Mar  75 

5.975 

2,137 

2.79 

9,649 

1,066 

1.61 

0.18 

■  • 

Apr  75  -  Mar  76 

7,549 

3,614 

2.09 

13,835 

1,979 

1.33 

0.26 

Apr  76  -  Mar  77 

5,379 

3,177 

1.69 

10,873 

1,716 

2.02 

0.32 

Apr  77  -  Mar  78 

7,396 

2.606 

3.03 

9,022 

2,207 

1.14 

0.28 

... 

CH-3C 

•  ft 

Apr  72  -  Mar  73 

26,421 

21,579 

1.22 

125,039 

16,421 

4.73 

0.62 

t  1 

Apr  73  -  Mar  74 

26,534 

21,517 

1.23 

127,683 

18,359 

4.81 

0.69 

«  d 

Apr  7a  -  Mar  75 

28,080 

22.703 

1.24 

142,575 

18,411 

5.08 

0.66 

Apr  75  -  Mar  76 

22,873 

21,722 

1.05 

133,246 

16,506 

5.82 

0.72 

\  ; 

Apr  76  -  Mar  77 

16,621 

22,083 

0.75 

142,465 

21,309 

8.57 

1.31 

*  1 

•  • 

Apr  77  -  Mar  78 

27,963 

22,557 

1.24 

150,441 

22,109 

5.38 

0.79 

HH-53 _ 

n 
•  £ 

Apr  72  -  Mar  73 

22,313 

26,262 

1.18 

139,617 

21,079 

6.26 

0.94 

«  a 

Aor  73  -  Mar  74 

16,218 

20,361 

1.26 

126,658 

19,585 

7.81 

1.21 

Apr  74  -  Mar  75 

16,272 

19,620 

0.83 

118,460 

20,655 

7.28 

1.27 

Apr  75  -  Mar  76 

13,639 

18,598 

0.73 

115,865 

17.159 

3.45 

1.26 

1 

Apr  76  -  Mar  77 

3,676 

22',  790 

0.38 

157,771 

24,285 

18.18 

2.30  ! 

Apr  77  -  Mar  78 

14,383 

25,063 

0.59 

165,379 

23,374 

11.14 

1.57 

n 

173 


MEAN  TME  IETWEEN  MAINTENANCE  EVENTS  |M(M  kMft) 


Figure  65.  MEAN  TIME  BETWEEN  MAINTENANCE 

EVENTS  AND  MAINTENANCE  MANHOURS 
PER  FLIGHT  HOUR  FOR  UH -IF 


TEAR  BRIM  31  MARCH 


Figure  66.  MEAN  TIME  BETWEEN  MAINTENANCE 

EVENTS  AND  MAINTENANCE  MANHOURS 
PER  FLIGHT  HOUR  FOR  UH-1N 


HMERENT  MAMTENANCE  MANHOURS  PER  FUBNT  HOUR  RIHERENT  MAINTENANCE  MANHOURS  PER  FlISHT 


Figure  67.  MEAN  TIME  BETWEEN  MAINTENANCE 

EVENTS  AND  MAINTENANCE  MANHOURS 
PER  FLIGHT  HOUR  FOR  HH-1H 


Figure  68.  MEAN  TIME  BETWEEN  MAINTENANCE 

EVENTS  AND  MAINTENANCE  MANHOURS 
PER  FLIGHT  HOUR  FOR  CH-3C 


ISO 


TIME  BETWEEN  MAINTENANCE  EVENTS  (flight  hours) 


INHERENT  MAINTENANCE  MANHOURS  PER  FLIGHT  HOUR 


Table  35.  USAF  HELICOPTER  RELIABILITY  AND  MAINTAINABILITY 
TRENDS,  1972-1978 


Hel i copter 
Type 

Mean  Time 
Between 

Ma i ntenance 
Events 

Inherent  Mainte 
per  Fliq 

lance  Manhours 
it  Hour 

Intermedi ate 

UH  - 1  F 

Constant 

Cons  tant 

Better 

UH-1N 

Wors  e 

Worse 

Better 

HH-1H 

Worse 

Constant 

Worse 

CH-3C 

Wors  e 

Worse 

Wors  e 

HH-53 

Worse 

Worse 

Worse 

Secti on  III 


Service  Mishap  Rates 


All  three  Services  maintain  reporting  systems  for  air¬ 
craft  "mishaps."  Prior  to  January  1,  1977,  these  reporting 
systems  were  all  similar  in  concept  but  differed  in  detail 
among  the  Services.  Effective  January  1,  1977,  Department 
of  Defense  Instruction  1000.19  prescribed  standardized  pro¬ 
cedures  for  mishap  reporting  [59] •  There  are  different  cate¬ 
gories  of  mishaps,  but  in  general  they  cover  all  incidents  of 
a  dangerous  or  potentially  dangerous  character — from  minor 
incidents  (such  as  precautionary  landings)  through  major 
accidents,  in  which  the  aircraft  is  heavily  damaged  or  lost. 
The  cause  of  the  accident  is  also  reported;  there  are  a  number 
of  cause  categories,  and  more  than  one  may  be  involved  in  a 
single  mishap.  For  example,  if  a  transmission  warning  light 
indicates  an  incipient  transmission  failure  and  the  pilot 
damages  the  landing  gear  in  making  an  emergency  landing,  that 
mishap  may  show  both  "Materiel  Failure"  and  "Pilot  Error"  as 
having  contributed  to  the  accident. 

A.  REPORTING  SYSTEMS  AND  AVAILABLE  DATA 

Each  Service's  reporting  system  and  available  data  are 
discussed  separately  below. 

1  .  Army 

The  Army  mishap  data  are  reported  by  the  U.S.  Army  Safety 
Center  (USASC),  Fort  Rucker,  Alabama.  The  reporting  starts 
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with  the  introduction  of  the  aircraft  into  regular  service  use; 
the  test  period  prior  to  service  use  is  not  covered. 

In  the  Army  reporting  system  prior  to  1977,  mishaps  were 
categorized  as  total  losses,  major  accidents,  minor  accidents, 
incidents,  forced  landings,  precautionary  landings,  ground,  and 
other.  The  difference  between  major  and  minor  accidents  and 
between  minor  accidents  and  incidents  was  established  for 'each 
aircraft  type  by  the  cost  to  repair.  Since  January  1,  1977, 
mishaps  have  been  categorized  in  five  classes  as  follows: 

Class  A.  Cost  >  $200,000;  or  aircraft  missing,  abandoned, 

destroyed,  uneconomically  repairable;  or  fatality. 

Class  B.  $50,000  <  Cost  <  $200,000. 

Class  C.  $300  <  Cost  <  $50,000;  or  lost  workdays. 

Class  D.  Cost  <  $300  and  lost  workday  case  involving  days 
of  restricted  work  activity. 

Class  E.  Cost  <  $300  and  no  injury  requiring  more  than 
first  aid. 

Class  A  plus  B  mishaps  are  substantially  equal  to  the  pre-1977 
total  losses  plus  major  accidents  and  minor  accidents.  Classes 
C  +  D  +  E  are  substantially  equal  to  the  old  incidents  plus 
forced  landings,  plus  precautionary  landings,  plus  ground,  plus 
other . 

The  Army  reporting  system  (both  before  and  after  DODI 
1000.19)  includes  the  following  summary  "Cause  Factors": 

•  Personnel 

Flight  Crew 
Ground  Crew 
Supervisory 

•  Environmental 

Facilities 

Command 

Training 
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•  Materiel 1 

Failure/Malfunct ion 

Maintenance 

Design 

•  Weather 

•  Undetermined . 

As  already  noted,  it  is  possible  that  a  single  mishap  may 
involve  more  than  one  cause  factor — which  is  true  even  within 
the  major  cause-factor  categories.  For  example,  a  mishap 
involving  materiel  may  be  charged  to  more  than  one  of  the 
three  sub factors  under  materiel. 

For  each  helicopter  type,  we  received  mishap  data  from 
USASC  for  the  active  Army  worldwide  inventory;  these  data 
exclude  mishaps  caused  by  combat.  The  Army  indicated  that 
its  mishap  data  before  FY  1968  were  less  reliable  and  advised 
against  our  using  them.  Accordingly,  the  data  reported  herein 
cover  the  twelve  FYs  1968-79.  For  each  helicopter  type,  we 
assembled  the  following  data  by  fiscal  year: 

•  Number  of  flight  hours 

•  Number  of  accidents  (total  of  total  losses  plus 
both  major  and  minor  accidents;  or  Classes  A  +  B): 

•  Materiel  failure 

•  Total . 

•  Number  of  mishaps  (total  of  three  accident  types 
plus  incidents,  forced  landings,  precautionary 
landings,  ground,  and  other;  or  Classes  A  through  E) : 

•  Materiel  failure 

•  Total . 

Using  these  data,  we  calculated  mishap  rates  per  10,000  flight 
hours  (Table  36).  Table  36  does  not  repeat  the  data  for  FYs 
1968-73  which  were  included  in  our  1975  study  [1] .  In  Table 
36  the  accident  figures  for  FY  1977-79  are  Class  A  +  B  mishaps 


lrIhe  Army  and  Air  Force  use  this  spelling;  the  Navy  uses  "Material." 
In  this  report  we  use  "Materiel"  throughout. 
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MISHAPS  OF  ARMY  HELICOPTERS 
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Source:  U.S.  Army  Safety  Center,  Fort  Rucker,  Alabama. 


under  the  new  classification  system.  The  four  mishap  rates 
are  plotted  versus  fiscal  year  in  Figure  70.  In  some  cases 
when  a  helicopter  was  entering  or  being  phased  out  of  service 
and  the  mishap  rates  were  not  meaningful,  the  data  for  those 
years  were  not  included  in  our  tables  or  figures. 

Mishap  rates  involving  materiel  were  shown  because  they 
should  reflect  reliability  growth  (if  any)  in  the  helicop'ter 
fleet  being  achieved  through  design  or  process  improvement. 

The  mishap  rates  were  plotted  on  semi-log  paper  so  that  equal 
rates  of  change  would  be  parallel  at  any  location  on  the 
paper.1  For  both  accident  rates  and  total  mishap  rates,  the 
change  in  rates  involving  materiel  generally  followed  the  total 
rates.  In  most  cases,  surprisingly,  the  rates  for  all  mishaps 
tended  to  increase  over  time,  while  the  accident  rates  tended 
to  decrease.  In  discussing  these  results,  USASC  personnel 
offered  the  following  probable  reasons  for  these  two  trends. 

(1)  Serious  problems  causing  accidents  tend  to  be  cor¬ 
rected  first  (thus  reducing  the  accident  rate),  while 
minor  problems  receive  less  attention. 

(2)  With  the  deceleration  of  the  Vietnam  conflict,  less 
mission  pressure  encouraged  pilots  to  make  precau¬ 
tionary  landings  in  order  to  reduce  the  possibility 
of  accidents . 

( 3)  Though  the  development  of  better  fault-warning  sys¬ 
tems  has  increased  precautionary  landings  and  other 
incidents,  it  has  reduced  accidents. 

(4)  Progressively  more  mishaps  occur  as  the  fleet  ages, 
much  as  is  the  case  with  old  automobiles. 

Hence,  though  there  appears  to  be  increasing  reliability  inso¬ 
far  as  accidents  are  concerned,  there  appears  to  be  a  deterio¬ 
ration  in  reliability  insofar  as  all  mishaps  (both  those 
involving  materiel  and  total)  are  concerned. 


^ince  log  paper  does  not  go  to  0.0,  a  zero  accident  rate  (whenever  it 
occurred)  was  plotted  at  the  bottom  of  the  mishap-rate  scale. 
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MISHAP  RATES  FOR  ARMY  HELICOPTERS 


CH-47  SERIES  F  CH-54  SERIES 
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2 .  Navy 

Navy  mishap  data  are  reported  by  the  Naval  Safety  Center 
(NSC),  Norfolk,  Virginia.  The  reporting  starts  with  the  test¬ 
ing  of  the  aircraft  at  the  Naval  Air  Test  Center,  Patuxent 
River.  However,  the  data  we  obtained  for  helicopters  during 
this  period  appeared  unreliable,  and  only  data  for  regular 
Service  use  appeared  usable  for  our  purposes.  In  the  Navy 
reporting  systems,  mishaps  are  broken  down  as  follows: 

•  Major  Accident  -  Involves  loss  or  substantial  damage 

to  aircraft. 

•  Minor  Accident  -  Minor  or  limited  damage. 

•  Incident  -  Very  minor  damage  or  no  damage  (e.g., 

an  engine  failure  followed  by  a  suc¬ 
cessful  autorotative  landing,  or  an 
abort  following  main  engine  start). 

•  Ground  Mishap  -  No  intent  to  fly  (includes  injuries 

to  maintenance  personnel  during 
maintenance) . 

The  difference  between  major  and  minor  accidents  is  established 
for  each  aircraft  type  by  the  cost  to  repair. 

The  Navy  reporting  system  includes  the  following  "Contrib- 
ut ing  Causes" : 

•  Pilot 

•  Other  Personnel 

•  Materiel 

Failure  or  Malfunction 
Design 

Maintenance-Personnel- Induced 
Pilot-Induced 

•  Weather 

•  Airport  Facility 

•  Carrier/LPH  Facility. 

There  are  a  number  of  other  contributing  causes,  in  addition 
to  those  listed  above.  However,  the  great  majority  of  mishaps 
involve  the  first  three  categories  above  (including  the 
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subcategories  under  "Materiel").  As  with  the  Army,  it  is 
possible  that  a  single  mishap  may  involve  more  than  one  cause. 


For  each  helicopter  type  now  in  Navy  service,  we  received 
mishap  data  from  the  fiscal  year  of  introduction  into  service 
through  FY  1974  and  for  CY  1975  through  1979  for  the  Navy  world¬ 
wide  inventory;  the  Navy  excluded  mishaps  caused  by  combat  in 
these  data.  For  each  helicopter  type,  we  assembled  the  follow¬ 
ing  data  by  fiscal  year: 


•  Number  of  flight  hours. 

•  Number  of  major  accidents: 

•  Involving  pilot  error 

•  Involving  other  personnel  error 

•  Involving  materiel  failure 

•  Total. 

•  Number  of  minor  accidents  or  incidents: 

•  Involving  pilot  error 

•  Involving  other  personnel  error 

•  Involving  materiel  failure 

•  Total. 

•  Ground  Mishaps: 

•  Involving  pilot  error 

•  Involving  other  personnel  error 

•  Involving  materiel  failure 

•  Total. 

•  Total  Mishaps: 

•  Involving  pilot  error 

•  Involving  other  personnel  error 

•  Involving  materiel  failure 

•  Total. 


Although  the  present  Navy  system  reports  minor  accidents  sepa¬ 
rately  from  incidents,  prior  to  FY  1968  the  two  were  reported 
as  a  single  category.  For  this  reason,  in  order  to  have  a 
consistent  time  series  we  have  combined  them,  since  all  Navy 
helicopter  types  presently  in  service  were  in  the  inventory 
before  FY  1963.  Using  these  data,  we  calculated  mishap  rates 
per  10,200  flight  hours  (Table  37).  Table  37  does  not  repeat 
the  data  for  FYs  through  1 9 T 3  which  were  included  in  our  1975 
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MISHAPS  OF  NAVY  HELICOPTERS 


I  V.  ■]  |  47  ,i  [  bd.  a  | 

(continued  on  next  page) 


(continued  on  next  page) 


(continued  on  next  page) 


study  [1].  In  general,  there  are  somewhat  fewer  major  acci¬ 
dents  than  ground  mishaps,  while  the  great  majority  of  mishaps 
Involve  minor  accidents  or  incidents.  However,  even  though 
major  accidents  account  for  the  fewest  mishaps  of  the  three 
categories,  they  are  probably  the  most  important  in  terms  of 
total  cost  (both  in  materiel  loss  and  in  injuries  and  fatali¬ 
ties).  Major  accident  rates  (involving  materiel  and  total) 
and  all  mishaps  (involving  materiel  and  total)  were  plotted 
versus  year  (Figure  71).  In  some  cases  when  a  helicopter  was 
entering  service  and  the  mishap  rates  were  not  meaningful,  the 
data  for  those  years  were  not  included  in  our  tables  or  figures. 

NSC  has  made  no  change  in  their  reporting  system  as  a 
result  of  DODI  1000.19;  they  are  considering  some  changes  that 
may  become  effective  in  1981. 

The  general  pattern  of  the  Navy  mishap  rates  is  similar 
to  that  for  the  Army.  In  general,  the  major  accident  rates 
decreased  over  time  while  the  total  mishap  rates  Increased. 

In  addition  to  the  reasons  proposed  by  USASC  personnel,  per¬ 
sonnel  at  NSC  felt  that  the  quality  and  attitude  of  mainte¬ 
nance  personnel  were  also  factors  in  the  worsening  mishap  rate. 
They  indicated  that  (1)  the  better  maintenance  personnel  are 
assigned  to  the  newer  aircraft  types,  and  (2)  their  degree  of 
eagerness  decreases  with  the  age  of  the  aircraft .  They  also 
believe  that  the  increasing  total  mishap  rates  may  be  parti¬ 
ally  caused  by  more  complete  reporting  of  mishaps  over  time. 


Secti on  IV 


Helicopter  Product  Improvement  Programs 


After  helicopters  enter  service  use,  changes  are  often 
incorporated  in  them  under  Product  Improvement  Programs  (PIPs). 
Depending  upon  the  nature  of  the  modification,  the  work  may  be 
accomplished  at  the  organizational,  intermediate,  or  depot 
level  of  service  maintenance  activity,  or  by  the  manufacturer. 

The  Army  assigns  one  of  the  following  eight  justification 
codes  (JCs)  to  each  PIP: 


(1)  Safety 

(2)  New  or  Improved  Operational  Capabilities 

(3)  Cost  Reduction 
P  =  Production 

O&S  =  Operations  and  Support 

(4)  RAM 

(5)  Deficiency  Corrections 

(  6 )  Compatib ility /Standard iz at ion/Environmental/ 
Simplif icat ion 

(7)  Legislative  Compliance 

(3)  Energy  Conservation. 


Table  33  shows  Army  PIP  dollars  for  all  current  basic  heli¬ 
copter  types  in  service  use.  PIPs  designated  as  RAM  (JC4) 
are  shown  separately  in  Table  33.  Although  each  PIP  is 
assigned  to  a  single  JC,  in  reality  PIPs  almost  always  have 
implications  in  more  than  one  JC.  Virtually  any  PIP  will 
have  some  impact  on  R&M  characteristics;  depending  on  the 
particulars  of  the  modification  involved,  it  could  either 
improve  or  degrade  R&M  characteristics.  Indeed,  the  same 
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Table  38.  U.S.  ARMY  HELICOPTER  PRODUCT  IMPROVEMENT  PROGRAMS 

(Million  Dollars) 


KSfll 

JC 

■SH 

FY  80 

FY  81 

FY  82 

AH  - 1 

4 

0.18 

0 .00 

0.00 

0.00 

0.00 

Other 

301 .49 

296.34 

157.77 

131  .57 

258.82 

1-8 

301.67 

296.34 

777.77 

nr.77 

27 or 

CH-47 

4 

24.67 

34.57 

51  .25 

54.53 

36.95 

Other 

139.89 

55.54 

181  .89 

222.68 

230.19 

1-8 

'TOT 

253.14 

27T.T4' 

CH-54 

4 

0.33 

1.11 

1.36 

0.27 

Other 

1.54 

1.27 

0.72 

0.08 

1-8 

777 

T35 

T.TT2 

6.35 

EH-1 

4 

0.00 

0.00 

Other 

50.17 

19.25 

1-8 

'"57.T7 

19.25 

EH-60 

4 

0.00 

Other 

0.98 

16.38 

1-8 

0.98 

TO! 

OH-58 

4 

0.00 

0.04 

0.07 

0.78 

0.75 

Other 

101.55 

1.68 

19.32 

44.86 

38.26 

1-8 

177757 

1.72 

“17737 

'TOT 

~1S75\ 

OH-6 

4 

0.20 

0.81 

0.90 

0.95 

Other 

2.06 

0.25 

0.67 

0.26 

0.00 

1-8 

m 

or 

ttt 

07 

6.95 

TH-55 

4 

0.00 

0.00 

0.00 

0.00 

0.00 

Other 

0.00 

0.00 

0.00 

0.48 

0.00 

1-8 

OJ 

or 

.  do 

TT5 

d.oo 

UH-1 

4 

10.96 

0.00 

2.84 

4.79 

3.65 

Other 

38.77 

7.88 

51  .19 

68.34 

57.69 

1-3 

~vm 

m 

74.03 

'1T.T2 

“777  n 

UH-60 

4 

0.00 

0.00 

0.00 

0.00 

0.00 

Other 

0.00 

0.34 

0.21 

10.91 

17.95 

1-8 

0.66 

“O'* 

or 

10.91 

“T7777 

Grand 

Total 

672.66 

435.36 

468. 10a 

542. 16a 

645. 56a 

5 Excludes  EH-1  and  EH-60. 


Source:  Office  of  Proauct  Improvement,  U.S.  Army  Materiel  Development 
&  Readiness  Conmand 
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PI?  could  both  improve  and  degrade  different  aspects  of  R&M 
characteristics.  For  example,  some  helicopters  have  been 
equipped  with  blade  inspection  method  (BIM)  indicators.  These 
indicators  sense  the  pressure  within  the  rotor  blade  spar  and 
give  a  cockpit  warning  if  the  blade  is  losing  pressure,  which 
could  be  caused  by  blade  crack  propagation.  These  devices 
tend  to  reduce  crashes,  but  at  the  same  time  they  give  many 
false  indications  leading  to  precautionary  landings.  Hence, 
this  device,  which  is  primarily  RAM  in  nature,  may  reduce  the 
number  of  catastrophic  failures  slightly  but  at  the  same  time 
cause  many  more  minor  failures  so  that  the  overall  failure 
rate  is  higher  with  the  BIM  than  without  it. 

Total  PIP  program  dollars  for  each  basic  helicopter  type 
in  Army,  Navy,  and  Air  Force  service  use  are  available  in  the 
Procurement  Annex  to  the  Five  Year  Defense  Program  under  the 
budget  appropriation  subtitle  "Modification  of  Aircraft." 

These  data  are  available  starting  with  FY  1969.  Unfortunately, 
the  Procurement  Annex  is  classified  Confidential.  In  order 
to  keep  this  study  unclassified,  they  are  not  included.  The 
Navy  helicopter  modification  dollars  are  comparable  to  those 
of  the  Army;  the  Air  Force  modification  program  is  much  smaller 
since  helicopters  are  not  as  widely  used  in  the  Air  Force  as 
in  the  other  services ,  and  tend  to  be  used  more  in  support  roles 
than  in  combat  mission  roles. 

The  Army  and  Navy  helicopter  modification  programs  are  each 
running  in  the  hundreds  of  millions  of  dollars  annually.  Yet 
with  the  single  exception  of  accidents,  we  found  no  R&M  char¬ 
acteristic  time  series  that  indicates  improvement  in  fleet  R&M 
characteristics  over  time.  Indeed,  the  Navy  3-M  time  series 
show  marked  degradation  in  R&M  characteristics  over  time. 
Although  PIP  dollars  do  not  appear  to  be  effective  in  improving 
R&M  characteristics  (other  than  accident  rates),  this  cannot  be 
a  firm  conclusion.  It  Is  possible  that  R&M  degradation  over 
time  might  be  even  worse  In  the  absence  of  the  PIPs . 


Section  V 


Army  Operationally  Ready  (OR)  Data 

Operationally  ready  data  show  the  percent  of  assigned  air¬ 
craft  that  are  operationally  ready  to  perform  their  assigned 
mission.  Those  not  operationally  ready  are  classified  as 
either  awaiting  spare  parts  (NORS)  or  maintenance  personnel 
(NORM)  to  work  on  them.  Accordingly,  the  operationally  ready 
(OR)  rate  reflects  the  basic  R&M  characteristics  of  the  air¬ 
craft,  and  also  the  level  of  spares  support,  the  level  and 
quality  of  assigned  maintenance  personnel,  the  flying  hour 
rate,  and  the  operating  environment  of  the  aircraft  (climatic, 
maintenance  facilities,  type  of  flying,  etc.).  Hence,  the  OR 
rate  is  not  a  pure  measure  of  R&M  characteristics,  but  it  is 
an  important  one  in  that  it  represents  the  prime  objective  of 
all  R&M  efforts — to  have  aircraft  ready  to  perform  their 
assigned  missions.  Assuming  the  other  factors  affecting  the 
OR  rate  remain  constant,  then  any  improvement  (or  worsening) 
of  R&M  characteristics  should  be  reflected  in  changes  in  this 
rate . 

The  Army  publishes  aircraft  operationally  ready  data 
monthly.  At  IDA's  request  TSARCOM  made  a  special  run  of 
all  helicopters  for  the  period  1967-1930.  The  data  were 
limited  to  "Forces  Command"  aircraft — those  aircraft  operated 
by  the  First,  Fifth  and  Sixth  Armies,  all  based  in  the  con¬ 
tinental  U.S.  (CONUS).  The  data  were  limited  to  CONUS-based 
aircraft  in  order  to  eliminate  (insofar  as  possible)  the 
effects  of  variable  operating  environments — particularly  the 
Vietnam  War  environment.  Data  in  this  special  run  were  pre¬ 
sented  both  monthly  and  as  annual  averages. 
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The  operationally  ready  rate  (in  percent)  is  calculated 
as  follows : 


OR  =  100  -  NORS  -  NORM 


where 

NORS  =  the  percent  of  aircraft  that  are  not  operationally 
ready  because  they  are  awaiting  spare  parts, 

NORM  =  the  percent  of  aircraft  that  are  not  operationally 
ready  because  they  are  awaiting  maintenance  ( per¬ 
sonnel  ) . 

In  addition  to  the  OR,  NORS,  and  NORM  figures,  the  data  show 
the  number  of  aircraft  assigned  and  the  hours  flown.  The 
TSARCOM  data  file  appears  to  be  incomplete  for  some  months  and 
years.  Accordingly,  we  dropped  some  helicopter  types  from  our 
data  base  completely,  and  for  others  we  restricted  the  number 
of  years  to  those  where  we  felt  sufficient  data  existed  to  be 
statistically  significant.  This  process  left  us  with  the  nine 
helicopter  types  whose  data  are  presented  in  Table  39  and 
Figure  72. 

Referring  to  Figure  72,  the  difference  between  the  top 
line  and  100  percent  represents  the  NORS  percent;  the  differ¬ 
ence  between  the  two  lines  represents  the  NORM  percent;  and 
the  lower  line  shows  the  resulting  OR  percent.  We  have  noted 
whether  the  overall  trend  of  the  OR  rate  appears  to  become 
better,  worse,  or  remain  constant  over  time.  These  overall 
trends  are  summarized  in  Table  40.  As  can  be  seen,  the  trends 
for  five  helicopters  remained  approximately  constant,  two 
worsened  slightly,  and  two  improved  slightly.  The  overall 
conclusion  based  on  these  data  is  that,  on  average,  Army  OR 
rates  generally  remain  constant  over  time. 


\ 

v 

* 

\ 


208 


Table  39.  ARMY  FORCES  COMMAND  HELICOPTER  STATUS 


nm 

HbK 

NORS3 

_ 

NORM3 

.  (5) 

wmEsmmi 

■  mm 

Hours  Flown 

CH-47A 

mm 

1974 

60.7 

o 

32.4 

24 

1 ,555 

1975 

66.3 

B 

19.9 

25 

3,249 

1976 

57.9 

131 

26.9 

35 

3, 111 

1977 

60.7 

12.3 

27.0 

27 

2,158 

1978 

55.5 

14.9 

29.7 

22 

1  ,282 

1979 

65.5 

12.6 

21  .9 

21 

1,710 

1980 

65.4 

10.1 

24.5 

22 

768 

CH-47B 

1973 

65.7 

10.5 

23.9 

44 

3,289 

1974 

70.1 

9.0 

20.9 

48 

6,068 

1975 

67.3 

8.0 

24.7 

56 

6,386 

1976 

60.5 

12.4 

27.1 

57 

5,527 

1977 

66.4 

9,7 

23.9 

55 

5,892 

1978 

72.2 

5.8 

22.0 

59 

6,375 

1979 

76.3 

5.0 

18,3 

60 

6,412 

1980 

65.0 

5,5 

29.8 

63 

3,971 

CH-47C 

1973 

72.3 

10.1 

17.6 

72 

4,986 

1974 

57.3 

19.3 

23.4 

78 

3,708 

1975 

66.0 

13.7 

20.3 

96 

11  ,522 

1976 

69.4 

11.7 

18.9 

100 

10,940 

1977 

72.6 

3.2 

19.2 

109 

14,046 

1978 

70.9 

10.5 

18.6 

107 

14,222 

1979 

66.7 

13.0 

20.3 

103 

12,383 

1980 

59.3 

10.5 

29.6 

80 

6,898 

‘Operationally  ready. 

aNot  operationally  ready  for  supply. 

3Not  operationally  ready  for  maintenance. 


(continued  on  next  page} 
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Table  39  ( continued) 


He! i copter 
Type  and 
Year 

OR 

fs) 

HORS 

(*>.  - 

■ell 1 

Hours  Flown 

UH-1H 

■■ 

1967 

83.2 

3.9 

l  | 

42 

6,788 

1968 

70.4 

10.2 

Hex 

5 

383 

1969 

71.4 

14. 0 

14.6 

8 

1 ,713 

1970 

73.7 

9.2 

17.1 

37 

11,638 

1971 

69.4 

13.6 

17.0 

59 

18,272 

1972 

71.3 

11.1 

17.5 

70 

23,549 

1973 

76.3 

9.2 

14.5 

960 

115,217 

1974 

77.2 

7.2 

15.6 

1,015 

206,873 

1975 

74.7 

7.9 

17.4 

1 ,128 

220,697 

1976 

76.0 

6.7 

17.3 

1,149 

207,893 

1977 

77.6 

4.7 

17.7 

1 ,144 

218,794 

1978 

76.0 

5.4 

18.5 

1,143 

206,285 

1979 

77.0 

5.6 

17.4 

1,104 

182,376 

1980 

73.0 

5.8 

21.2 

926 

89,336 

TH-1G 

1972 

64.5 

20.2 

15.3 

2 

180 

1973 

68.3 

15.8 

15.4 

10 

686 

1974 

52.7 

32.4 

14.9 

10 

747 

1975 

54.9 

18.7 

26.4 

11 

997 

1976 

57.4 

12.9 

29.7 

12 

808 

1977 

66.3 

5.2 

23.4 

9 

844 

1978 

58.1 

8.6 

33.3 

7 

484 

1979 

59.9 

4.8 

25.3 

7 

166 

0H-53A 

1969 

81.7 

10.0 

8.3 

3,241 

1970 

34.5 

6.2 

9.4 

13 

7,323 

1971 

79.0 

10.1 

10.9 

32 

11,149 

a0  in  July;  2  in  August  increasing  to  3  in  December. 


(continued  on  next  page) 
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a0  in  July,  4  in  August  increasing  to  7  in  December. 
b0  in  July;  3  in  August  increasing  to  25  in  December . 


(concluded  on  next  page) 
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Table  39  ( concl uded  ) 


I 

I 


Hel i  copter 
Type  and 
Year 

OR 

_ (!) 

NORS 

(*) 

NORM 

(S) 

Total 

Aircraft- 

July 

Hours  Flown 

fl 

23.6 

12.4 

4 

226 

■ESS 

EH 

23.9 

14.5 

3 

1,283 

1 

12.2 

17.6 

18 

2,073 

1974 

77.3 

9.6 

13.1 

22 

2,869 

1975 

71.4 

9.7 

18.9 

22 

3,355 

1976 

16.2 

20.9 

23 

2,986 

1977 

10.5 

16.2 

23 

2,842 

1978 

71.1 

12.8 

16.2 

23 

3,733 

1979 

72.3 

3.3 

18.9 

13 

2,037 

[ 


I 

I 

I 

I 

j 
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1966  1968  1970  1972  1974  1976  1978  1980 


(continued  on  next  page) 

Figure  72.  ARMY  FORCES  COMMAND  HELICOPTER  STATUS 
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Table  40.  U.S.  ARMY  FORCES  COMMAND  HELICOPTER 
OPERATIONALLY  READY  TRENDS 


Hel icoDter  Tyoe 

Operationally 

Ready  Trend 

CH-47A 

Constant 

CH-47B 

Better 

CH-47C 

Constant 

UH-1H 

Constant 

TH-1G 

Constant 

0H-58A 

Worse 

AH-1G 

Worse 

AH- IS 

Constant 

CH-548 

Better 

I 

I 

•*> 

i 

I 

! 

1 

l 

( 
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Section  VI 


Changes  in  Commercial  Aircraft  Reliability/Mainta inability 
Characteristics  Over  Time 


Over  80  percent  of  the  Free  World's  commercial  airliners 
are  produced  in  the  U.S.  and  are  widely  acknowledged  to  be  the 
best  in  the  world.  Accordingly,  their  R&M  characteristics  are 
probably  close  to  optimum  and  may  provide  insights  useful  in 
formulating  R&M  policies  for  military  aircraft. 

A.  MAINTENANCE  COSTS  AND  MAN-HOURS 

Figures  73  through  84  are  a  series  of  figures  obtained 
from  McDonnell  Douglas  Corporation  reports  which  depict  mainte¬ 
nance  cost  and  manhour  trends  for  three  generations  of  U.S. 
commercial  jet  transports.  These  figures  are  based  on  data 
reported  by  all  U.S.  air  carriers  to  the  Civil  Aeronautics 
Board  on  CAB  Form  41  reports. 

Figure  73  shows  annual  direct  maintenance  costs  in  current 
dollars  for  the  first  generation  of  four-engine  jets.  Figures 
7 L  and  75  show  the  breakdown  of  these  costs  by  airframe/ 
accessories  and  engines.  Figure  74  is  presented  in  cumulative 
terms  while  Figure  75,  like  Figure  73,  is  in  annual  terms. 

Since  Figure  74  shows  quite  stable  costs,  the  annual  airframe 
and  accessories  maintenance  costs  would  be  quite  similar  to 
the  cumulative  costs  shown.  The  engine  costs  generally 
decreased  through  1971  and  then  almost  doubled  from  1971  to 
1978. 

If  these  costs  are  corrected  for  inflation  using  the  Con¬ 
sumer  Price  Index,  the  real  costs  (for  the  entire  aircraft, 


Figure  73),  decreased  by  about  35  percent  from  I960  through 
1977.  Figure  76  confirms  this  decrease  in  real  costs;  it 
shows  that  maintenance  manhours  per  flying  hour  decreased  by 
about  50  percent  over  this  17-year  period. 

The  second  generation  of  U.S.  commercial  jets  were  the 
twin  and  tri  jets  shown  in  Figure  77:  the  Boeing  727  and  737 
and  the  McDonnell  Douglas  DC-9.  Figure  77  shows  the  cumula¬ 
tive  direct  maintenance  costs  in  constant  1977  dollars,  and 
Figures  78  and  79  show  the  breakdown  of  these  costs  by  airframe/ 
other  flight  equipment  and  engines.  Although  these  are  cumu¬ 
lative  plots,  the  fact  that  they  are  all  fairly  constant  after 
the  first  couple  of  years  indicates  that  annual  costs  stabi¬ 
lized  at  roughly  constant  levels  after  about  two  years.  This 
general  pattern  is  confirmed  by  Figure  80,  which  shows  that 
manhours  per  flying  hour  were  quite  constant  for  the  DC-9-30 
and  3-737,  while  they  decreased  somewhat  for  the  B-727. 

Plots  similar  to  those  for  the  twin  and  tri  jets  are 
presented  for  the  most  recent  generation  (the  wide  body  DC-10, 
3-747,  and  L-1011)  in  Figures  8l  through  84.  The  direct 
maintenance  costs  per  revenue  flight  hour  are  again  fairly 
constant  after  the  first  couple  of  years  for  the  B-747  and 
L-1011,  while  the  DC-10  exhibits  an  increase  over  the  entire 
period  due  entirely  to  increasing  engine  maintenance  costs. 
Manhours  per  flying  hour  are  again  fairly  constant  for  all 
three  wide  body  jets. 

B.  MECHANICAL  SCHEDULE  RELIABILITY 

Figures  85  through  90  depict  mechanical  schedule  reli¬ 
ability  (also  called  "dispatch  reliability"  or  "mechanical 
dispatch  reliability")  for  the  Boeing  707,  727,  737,  747;  the 
McDonnell  Douglas  DC-8,  DC-9,  DC-10;  and  the  Lockheed  L-1011 
aircraft.  Schedule  interruptions  due  to  mechanical  problems 
Include  cancellations,  air  turnbacks,  diversions,  and  departure 


218 


delays  greater  than  15  minutes.  This  measure  of  reliability 
is  similar  to  the  "Mission  Reliability"  used  by  the  military 
services . 

The  first  jet  airliner  produced  in  this  country  (the 
707-100)  required  about  five  years  to  reach  its  mature  level 
of  schedule  reliability.  Later  models  (the  707-300  and 
-300B/C)  required  only  two  or  three  years.  The  next  completely 
new  Boeing  aircraft  (the  727)  reached  its  mature  level  of 
schedule  reliability  in  only  about  six  months,  while  the  next 
Boeing  (the  737)  had  a  very  high  schedule  reliability  when  it 
was  first  put  into  service.  The  most  recent  Boeing  aircraft 
to  enter  service  (the  7^7)  exhibited  a  growth  in  schedule  reli¬ 
ability  much  like  that  of  the  707-100.  The  7^7,  mainly  due 
to  engine  reliability  problems,  required  about  three  years  to 
reach  its  mature  level  of  schedule  reliability. 

The  DC-8,  which  closely  followed  the  Boeing  707-100, 
also  required  about  five  years  to  reach  its  mature  level  of 
schedule  reliability,  but  it  was  somewhat  more  reliable  than 
the  707-100  throughout  this  growth  period.  The  next  genera¬ 
tion  McDonnell  Douglas  transport,  the  DC-9,  was  quite  similar 
in  schedule  reliability  to  the  Boeing  727  and  737  (see  Figures 
36  and  88);  all  three  aircraft  exhibited  a  high  initial  reli¬ 
ability.  The  DC-9fs  reliability  grew  slightly  during  the 
first  three  years  of  service  and  stabilized  slightly  above  the 
levels  of  the  Boeing  727  and  737.  The  most  recent  McDonnell 
Douglas  aircraft,  the  DC-10,  had  a  fairly  high  initial  reli¬ 
ability  and  reached  its  mature  level  of  reliability  after  about 
three  years  in  service  (see  Figure  89). 

The  Lockheed  L-1011  (Figure  90)  required  roughly  two 
years  to  reach  its  mature  level  of  schedule  reliability. 

These  reliability  trends  indicate  some  improvement  in 
the  later  models  relative  to  the  first  generation  jet  trans¬ 
ports,  the  3oeing  707-13C  and  the  DC-3.  As  indicated  by  the 
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Boeing  727  and  737  and  the  McDonnell  Douglas  DC-9,  it  is  pos¬ 
sible  (and  certainly  desirable)  to  develop  new  aircraft  with 
very  high  initial  levels  of  schedule  reliability.  When  prob¬ 
lems  are  encountered  early  in  the  service  life  (as  in  the  case 
of  the  latest  generation  of  wide  body  jet  transports),  they  are 
corrected  within  two  or  three  years  after  introduction  into 
service  use. 

C.  SUMMARY  AND  CONCLUSIONS 

The  trends  in  maintenance  costs,  maintenance  manhours, 
and  mechanical  schedule  reliability  are  summarized  in  Table  41. 
First  generation  commercial  Jets  were  the  only  ones  to  show 
long  term  (i.e.,  greater  than  three  year)  improvement  trends. 
Second  generation  jets  showed  little  improvement  in  any  R&M 
measure  after  introduction  into  service;  they  were  basically 
good  when  introduced.  Third  generation  jets  experienced  some 
reliability  problems  with  their  high  by-pass  ratio  engines, 
but  R&M  characteristics  stabilized  after  two  or  three  years. 

It  appears  that  the  commercial  aircraft  manufacturers 
strive  to  develop  their  aircraft  to  a  mature  level  of  R&M  char¬ 
acteristics  prior  to  introduction  of  the  aircraft  into  service. 
When  problems  have  developed  in  the  last  two  generations  of 
jets,  they  have  been  corrected  within  two  or  three  years  follow¬ 
ing  introduction  into  service;  thereafter,  R&M  characteristics 
have  remained  quite  constant. 
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Figure  73.  DIRECT  MAINTENANCE  COSTS,  U.S.  OPERATORS, 
FOUR  ENGINE  JETS 
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Figure  74.  DIRECT  MAINTENANCE  COSTS,  AIRFRAME  AND 
ACCESSORIES.  FOUR  ENGINE  JETS 
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Figure  75.  DIRECT  MAINTENANCE  COSTS,  'J.S.  OPERATORS, 
ENGINES,  FOUR  ENGINE  JETS 
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Figure  76.  MAINTENANCE  MANHOURS  PER  FLYING  HOUR, 
U.S.  OPERATORS,  FOUR  ENGINE  JETS 
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Figure  77.  EQUIVALENT  DIRECT  MAINTENANCE  COSTS  (TOTAL) 
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Figure  78.  EQUIVALENT  DIRECT  MAINTENANCE  COSTS 

(AIRFRAME  AND  OTHER  FLIGHT  EQUIPMENT) 
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•  OUTSIOE  REPAIR  EQUATED  TO  "IN-HOUSE"  COSTS 
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Tomarisons,  McDonnell  Douglas  Corporation,  January  1980. 

Figure  79.  EQUIVALENT  DIRECT  MAINTENANCE  COSTS,  ENGINES 


Source:  Tomsreial  Transport  Asratians  ana  'ii-.nttranct  Tata  Jjmar-i , 
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Figure  80.  MAINTENANCE  MANHOURS  PER  FLYING  HOUR, 
U.S.  OPERATORS,  TWIN  &  TRI  JETS 
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•OUTSIDE  REPAIR  EQUATED  TO  "IN-HOUSE"  COSTS 
•  EXPENSES  EQUATED  TO  CONSTANT  1977  DOLLARS 
•STAGE  LENGTH  EQUATED  TO  3.2  HOURS  PER  FLIGHT 
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Figure  81.  EQUIVALENT  OIRECT  MAINTENANCE  COSTS  (TOTAL) 
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Figure  82. 


EQUIVALENT  DIRECT  MAINTENANCE  COSTS 
(AIRFRAME  AND  OTHER  FLIGHT  EQUIPMENT) 


<3-0 


•OUTSIDE  REPAIR  EQUATED  TO  MN-HOUSE"  COSTS 
•EXPENSES  EQUATED  TO  CONSTANT  1977  DOLLARS 
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Figure  83.  EQUIVALENT  DIRECT  MAINTENANCE  COSTS,  ENGINES 
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Figure  84.  MAINTENANCE  MANHOURS  PER  FLYING  HOUR, 
U.S.  OPERATORS,  WIDE  BODY  JETS 
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Figure  87.  MECHANICAL  SCHEDULE  RELIABILITY,  DC-8 


Source:  McDonnell  Douglas  Corporation 


Figure  88.  MECHANICAL  SCHEDULE  RELIABILITY,  DC-9  AND  B - 7 37 
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Table  41.  SUMMARY  OF  TRENDS  IN  COMMERCIAL  AIRCRAFT 

RELIABILITY/MAINTAINABILITY  CHARACTERISTICS 


Jet  Transport 
Generation 

Direct 
Maintenance 
Costs  in 
Constant 
Dollars 

Maintenance 
Manhours 
per  Flying 
Hour 

Mechanical 

Schedule 

Rel iabil ity 

First  Generation 
(Four  Engine  Jets) 

Decreased 
about  35% 
over  first 

17  years. 

Decreased 
about  50% 
over  first 

17  years. 

B- 707- 100  and  DC-8 
required  about  five 
years  to  maturity; 
later  B-707  models 
required  two  or 
three  years. 

Second  Generation 
(Twin  and  Tri  Jets) 

Approxi¬ 

mately 

constant 

SI ight 
reduction 

B-727  and  737  and 

DC-9  all  had  high 
initial  reliability; 
DC- 9  grew  to  a 
slightly  higher 
level  during  first 
three  years  of 
service. 

Third  Generation 
(Wide  Body  Jets) 

B-747  &  L- 1011 

DC- 10 

Approxi¬ 

mately 

constant 

Some 

increase 
due  to 
engines 

1  Approxi¬ 
mately 
constant 

Required  two  to 
three  years  to 
|  maturity 
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Chapter  IV 


CONSIDERATIONS  IN  THE  ALLOCATION  OF  RESOURCES 
FOR  R&M  GROWTH  OURING  THE  DEVELOPMENT  PHASE 
VERSUS  DURING  THE  PRODUCTION  PHASE 


There  are  a  number  of  factors  that  should  be  considered 
in  deciding  whether  to  allocate  resources  for  R&M  growth 
during  the  development  phase  or  during  the  production  phase 
of  a  helicopter  program.  Factors  that  favor  allocation  of 
resources  during  each  phase  are  summarized  in  Table  42  and 
are  discussed  below;  the  discussion  is  tied  to  the  numerical 
listing  of  factors  in  the  Table. 


Table  42.  FACTORS  THAT  FAVOR  ALLOCATION  OF  RESOURCES 
FOR  R&M  GROWTH  DURING  THE  DEVELOPMENT  PHASE 
AND  DURING  THE  PRODUCTION  PHASE 


Development  Phase 

Production  Phase 

1.  Should  achieve  a  greater 
improvement  in  R&M  per  unit 
cost  and  time  because  of 

Duane  curve  characteristics. 

2.  R&M  growth  program  should  be 
more  cost-effective  because 
of  controlled  management  and 
operating  environment. 

3.  Improvements  do  not  have  to 
be  retrofitted  on  delivered 
a  i  rcra  ft . 

4.  Improved  R&M  characteristics 
available  over  entire  life 
of  aircraft. 

1.  Development  phase  costs  less 
(but  production  phase  will 
cost  more  if  R&M  growth  is 
deferred  to  it). 

2.  Development  phase  may  take 
less  time,  resulting  in  pos¬ 
sible  earlier  IOC  date. 

3.  Earlier  discovery  of  those 
failure  modes  induced  by 
field  environment. 
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A. 


FACTORS  FAVORING  R&M  GROWTH  DURING  DEVELOPMENT  PHASE 


1.  As  discussed  in  Chapter  II,  helicopter  development 
programs,  in  a  very  rough  way,  tend  to  follow  the  Duane  growth 
process.  This  process  is  characterized  by  a  continual  reduc¬ 
tion  in  the  degree  of  R&M  improvement  per  unit  of  cost  or  time 
required  to  achieve  the  improvement  (see  Figures  S-2  and  S-3) . 
Since  fewer  flight  hours  have  been  accumulated  in  the  develop¬ 
ment  phase  than  in  the  production  phase,  it  should  be  possible 
to  achieve  a  greater  degree  of  R&M  improvement  per  unit  of  cost 
or  time  in  the  development  phase.  Further,  while  virtually 
all  programs  exhibit  R&M  improvement  during  the  development 
phase,  there  is  no  clear-cut  evidence  that  R&M  characteristics 
in  general  Improve  during  the  production  phase.  Indeed,  some 
data  indicate  that  they  worsen  (see  3-M  data  of  Chapter  III, 
Section  I ) . 

2.  R&M  growth  programs  during  the  development  phase  would 
be  conducted  at  the  manufacturer’s  plant  or  at  a  service  test 
facility  in  CONUS  where  manufacturer's  personnel  could  be  sta¬ 
tioned.  Accordingly,  the  operating  environment  is  such  that 
information  on  failures  can  be  quickly  collected  and  fixes 
developed,  thus  facilitating  the  R&M  growth  process.  On  the 
other  hand,  once  a  helicopter  is  in  production  and  operating 

in  the  field  (perhaps  overseas),  the  collection  and  transmittal 
of  failure  data  is  much  less  complete  and  fast,  and  the  time 
required  to  incorporate  fixes  Into  aircraft  in  the  field  Is 
much  greater.  Further,  in  order  to  incorporate  changes  in  a 
production  program  it  is  necessary  to  change  production 
drawings/processes/toollng  and  in  general  interfere  with  the 
smooth  functioning  of  the  production  process.  Hence  R&M  growth 
programs  should  be  considerably  more  cost-effective  during  the 
development  phase  because  of  the  more  favorable  management  and 
operating  environment.  One  quantitative  survey  concluded  that 
production  phase  changes  are  ten  times  as  costly  as  develop¬ 
ment  phase  changes  [3] • 
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3.  If  design  changes  to  achieve  R&M  growth  are  incorpo¬ 
rated  in  the  development  phase,  then  later  production  aircraft 
will  have  the  improved  designs  incorporated  in  them  when  they 
are  built.  However,  if  changes  are  made  during  the  production 
phase,  then  the  changes  must  be  retrofitted  into  those  aircraft 
which  have  already  been  produced.  This  retrofitting  is  more 
expensive  than  incorporating  changes  in  the  initial  construc¬ 
tion  of  the  aircraft.  Further,  retrofitting  aircraft  in  the 
field  degrades  the  mission  operational  readiness  of  the  units 
to  which  they  are  assigned. 

4.  If  R&M-related  changes  are  incorporated  during  the 
development  phase,  the  benefits  of  these  changes  are  available 
over  the  entire  life  of  the  aircraft.  If  changes  are  made 
during  the  production  phase,  then  the  benefits  are  not  realized 
in  the  already-produced  aircraft  until  they  are  retrofitted. 

B.  FACTORS  FAVORING  R&M  GROWTH  DURING  PRODUCTION  PHASE 

1.  and  2.  The  principal  advantage  of  deferring  R&M  growth 
resources  from  the  development  phase  to  the  production  phase 
is  that  the  cost  and  schedule  time  required  for  development  may 
be  reduced.  As  a  result,  an  earlier  IOC  date  can  be  achieved. 
This  could  be  a  very  important  consideration  in  some  programs, 
depending  on  the  military  threat  situation. 

3.  Some  R&M  problems  only  become  apparent  when  an  aircraft 
is  operating  in  its  normal  field  environment.  These  problems 
will  be  discovered  earlier  because  of  the  earlier  IOC  date,  but 
a  special  process  involving  data  collection,  engineering  follow¬ 
up  and  production  modification  is  required  for  timely  incorpo¬ 
ration  of  fixes  (as  in  the  Black  Hawk  program). 
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